00010000:00010000:1.0F:1788744880.273213:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744881.241282:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419884672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744881.241373:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744881.241437:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419885184:0@lo:400:kworker.0 00000100:00100000:1.0:1788744881.241463:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744881.241492:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419885696:0@lo:400:kworker.0 00000100:00100000:1.0:1788744881.241512:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744881.241526:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1875634419886208:0@lo:400:kworker.0 00000100:00100000:1.0:1788744881.241546:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744881.241568:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788744881.241575:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3634:1875634419884800:0@lo:400:kworker.0 00000100:00100000:1.0:1788744881.241601:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744881.241623:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419885312:0@lo:400:kworker.0 00000100:00100000:1.0:1788744881.241643:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744881.241658:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419885824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744881.241675:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744881.241688:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419886336:0@lo:400:kworker.0 00000100:00100000:1.0:1788744881.241703:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1788744881.242471:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419884672 00000100:00100000:2.0:1788744881.242508:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419884672 00000100:00100000:2.0:1788744881.242598:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744881.242611:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419884672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744881.242650:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788744881.242725:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419884672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744881.242733:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744881.242758:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419884800 00000100:00100000:2.0:1788744881.242762:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419884800 00000100:00100000:2.0:1788744881.242787:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788744881.242795:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3afa6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+24:3634:x1875634419884800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744881.242827:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3afa6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+24:3634:x1875634419884800:12345-0@lo:400:kworker.0 Request processed in 34us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744881.242833:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1788744881.242863:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744881.242898:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3634:1875634419884800:0@lo:400:kworker.0 00000100:00100000:2.0:1788744881.242922:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419884672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0F:1788744881.245375:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419884544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744881.245468:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744881.245503:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419885056:0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.245527:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744881.245548:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419885568:0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.245571:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744881.245588:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1875634419886080:0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.245625:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744881.245698:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788744881.245706:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419884928:0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.245744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744881.245762:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419885440:0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.245784:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744881.245801:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1875634419885952:0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.245820:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744881.245863:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419885184 00000100:00100000:0.0:1788744881.245872:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419885184 00000100:00100000:0.0:1788744881.245918:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419885696 00000100:00100000:0.0:1788744881.245921:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419885696 00000100:00100000:0.0:1788744881.245932:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419885056 00000100:00100000:0.0:1788744881.245935:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419885056 00000100:00100000:0.0:1788744881.245945:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419885568 00000100:00100000:0.0:1788744881.245947:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419885568 00000100:00100000:0.0:1788744881.245961:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744881.245970:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419885184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246025:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419885184:12345-0@lo:400:kworker.0 Request processed in 56us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246032:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744881.246065:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744881.246070:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419885696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246102:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419885696:12345-0@lo:400:kworker.0 Request processed in 31us (4588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246107:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744881.246118:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744881.246124:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419885056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246153:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419885056:12345-0@lo:400:kworker.0 Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246159:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744881.246171:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744881.246177:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419885568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246201:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419885568:12345-0@lo:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246207:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744881.246230:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419886208 00000100:00100000:0.0:1788744881.246234:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419886208 00000100:00100000:0.0:1788744881.246292:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419885312 00000100:00100000:0.0:1788744881.246295:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419885312 00000100:00100000:0.0:1788744881.246306:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419885824 00000100:00100000:0.0:1788744881.246308:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419885824 00000100:00100000:0.0:1788744881.246318:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419886336 00000100:00100000:0.0:1788744881.246321:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419886336 00000100:00100000:0.0:1788744881.246331:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419886080 00000100:00100000:0.0:1788744881.246333:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419886080 00000100:00100000:0.0:1788744881.246343:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419885952 00000100:00100000:0.0:1788744881.246345:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419885952 00000100:00100000:0.0:1788744881.246357:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744881.246362:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875634419886208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246401:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875634419886208:12345-0@lo:400:kworker.0 Request processed in 38us (4854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246408:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744881.246420:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744881.246425:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419885312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246449:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419885312:12345-0@lo:400:kworker.0 Request processed in 24us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246454:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744881.246464:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744881.246470:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419885824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246494:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419885824:12345-0@lo:400:kworker.0 Request processed in 25us (4819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246499:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744881.246510:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788744881.246515:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875634419886336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246537:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875634419886336:12345-0@lo:400:kworker.0 Request processed in 23us (4833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246541:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788744881.246552:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788744881.246557:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875634419886080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246579:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875634419886080:12345-0@lo:400:kworker.0 Request processed in 22us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246585:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788744881.246596:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788744881.246600:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875634419885952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246635:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875634419885952:12345-0@lo:400:kworker.0 Request processed in 34us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246641:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788744881.246679:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419884928 00000100:00100000:0.0:1788744881.246684:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419884928 00000100:00100000:0.0:1788744881.246708:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419885440 00000100:00100000:0.0:1788744881.246712:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419885440 00000100:00100000:0.0:1788744881.246725:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744881.246730:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419884928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246761:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419884928:12345-0@lo:400:kworker.0 Request processed in 31us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246766:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744881.246776:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788744881.246781:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419885440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246806:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419885440:12345-0@lo:400:kworker.0 Request processed in 26us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744881.246812:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788744881.246817:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419884544 00000100:00100000:2.0:1788744881.246824:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419884544 00000100:00100000:0.0:1788744881.246857:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419884928:0@lo:400:kworker.0 00000100:00100000:2.0:1788744881.246862:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788744881.246874:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419884544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744881.246875:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419885440:0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246891:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1875634419885952:0@lo:400:kworker.0 00002000:00000024:2.0:1788744881.246895:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788744881.246904:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419885056:0@lo:400:kworker.0 00000100:00100000:0.0:1788744881.246916:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419885568:0@lo:400:kworker.0 00010000:00080000:0.0:1788744881.246931:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288293480 x1875634419886080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744881.246941:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419884544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744881.246950:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744881.246964:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1875634419886080:0@lo:400:kworker.0 00000100:00080000:2.0:1788744881.246973:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744881.246985:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744881.246988:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744881.246991:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744881.247018:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419884544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744881.247024:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419885312:0@lo:400:kworker.0 00000100:00100000:2.0:1788744881.247042:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419885824:0@lo:400:kworker.0 00010000:00080000:2.0:1788744881.247056:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288293800 x1875634419886336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744881.247065:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419886336:0@lo:400:kworker.0 00000100:00100000:2.0:1788744881.247156:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419885184:0@lo:400:kworker.0 00000100:00100000:2.0:1788744881.247170:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419885696:0@lo:400:kworker.0 00000100:00100000:2.0:1788744881.247180:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1875634419886208:0@lo:400:kworker.0 00010000:00010000:1.0:1788744881.298649:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788744882.266061:0:17170:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1788744882.266084:0:17170:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ce3b402f9c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1788744882.266090:0:17170:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ce3b400f800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ce3812ed300 00000020:00080000:0.0:1788744882.266094:0:17170:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ce3b400f500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ce28769a800 00010000:00010000:3.0F:1788744882.268992:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3a00/0x6e465a23bbc29b81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744882.269016:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3a00/0x6e465a23bbc29b81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744882.269025:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3a00/0x6e465a23bbc29b81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744882.269032:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f3a00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:3.0:1788744882.269038:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3a00/0x6e465a23bbc29b81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744882.269045:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3a00/0x6e465a23bbc29b81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744882.269063:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce3af9f1100) 00010000:00010000:3.0:1788744882.269066:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744882.269072:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3a00/0x6e465a23bbc29b81 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744882.269079:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3a00/0x6e465a23bbc29b81 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788744882.269114:0:17228:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1788744882.269208:0:17228:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788744882.321233:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744883.345300:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744883.427613:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744883.427693:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396738688 00000100:00100000:1.0:1788744883.427703:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396738688 00000100:00100000:1.0:1788744883.427773:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00100000:1.0:1788744883.427786:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce28823f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+13:15586:x1875634396738688:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788744883.427893:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce28823f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+13:15586:x1875634396738688:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744883.427914:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00080000:2.0:1788744883.429395:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744883.438492:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744883.438561:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396738816 00000100:00100000:1.0:1788744883.438571:0:17189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396738816 00000100:00100000:1.0:1788744883.438636:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:1.0:1788744883.438646:0:17189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce28823df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbec6146-07af-44eb-a947-059296d3f720+5:15586:x1875634396738816:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788744883.438740:0:17189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce28823df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbec6146-07af-44eb-a947-059296d3f720+5:15586:x1875634396738816:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744883.438748:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00080000:3.0:1788744883.438798:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744883.487772:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788744883.487826:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396739072 00000100:00100000:0.0:1788744883.487836:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396739072 00000100:00100000:0.0:1788744883.487902:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 12 00000100:00100000:0.0:1788744883.487912:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbec6146-07af-44eb-a947-059296d3f720+13:15586:x1875634396739072:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788744883.488223:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbec6146-07af-44eb-a947-059296d3f720+14:15586:x1875634396739072:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 310us (460us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788744883.488230:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 12 00000100:00100000:3.0:1788744883.792577:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419886592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744883.792643:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744883.792686:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744883.792705:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419886464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744883.792741:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744883.792824:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419886592 00000100:00100000:0.0:1788744883.792832:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419886592 00000100:00100000:0.0:1788744883.792877:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419886464 00000100:00100000:0.0:1788744883.792880:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419886464 00000100:00100000:0.0:1788744883.792894:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744883.792901:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce28823c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419886592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744883.792930:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788744883.792968:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce28823c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419886592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744883.792975:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744883.792991:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744883.793002:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419886464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744883.793010:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788744883.793030:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419886464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744883.793035:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788744883.793098:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744883.793130:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419886464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744883.793141:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419886592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744884.300790:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744884.300843:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744884.300881:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744884.300912:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744884.300934:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744884.300954:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744884.300977:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744884.301015:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396739712 00000100:00100000:3.0:1788744884.301025:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396739712 00000100:00100000:3.0:1788744884.301074:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396740096 00000100:00100000:3.0:1788744884.301077:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396740096 00000100:00100000:3.0:1788744884.301089:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396739584 00000100:00100000:3.0:1788744884.301092:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396739584 00000100:00100000:3.0:1788744884.301107:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396740224 00000100:00100000:3.0:1788744884.301109:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396740224 00000100:00100000:3.0:1788744884.301139:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 33 00000100:00100000:3.0:1788744884.301149:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbec6146-07af-44eb-a947-059296d3f720+5:2394:x1875634396739584:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788744884.301438:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbec6146-07af-44eb-a947-059296d3f720+5:2394:x1875634396739584:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744884.301446:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 33 00000100:00100000:3.0:1788744884.301466:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 30 00000100:00100000:3.0:1788744884.301473:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbec6146-07af-44eb-a947-059296d3f720+5:2391:x1875634396739712:12345-192.168.201.46@tcp:9:kworker.0 00000020:00000080:3.0:1788744884.301507:0:18695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc298b7 00000100:00080000:3.0:1788744884.301518:0:18695:0:(import.c:65:import_set_state_nolock()) ffff9ce3afaff000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744884.301566:0:18695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788744884.301720:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbec6146-07af-44eb-a947-059296d3f720+2:2391:x1875634396739712:12345-192.168.201.46@tcp:9:kworker.0 Request processed in 247us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744884.301728:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 30 00000100:00100000:3.0:1788744884.301741:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 31 00000100:00100000:3.0:1788744884.301747:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dcb7d04-ec78-42ad-9337-5301be89146f+5:2391:x1875634396740096:12345-192.168.201.46@tcp:9:kworker.0 00000020:00000080:3.0:1788744884.301757:0:18695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc298ef 00000100:00080000:3.0:1788744884.301763:0:18695:0:(import.c:65:import_set_state_nolock()) ffff9ce3af9b6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744884.301787:0:18695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788744884.301855:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dcb7d04-ec78-42ad-9337-5301be89146f+2:2391:x1875634396740096:12345-192.168.201.46@tcp:9:kworker.0 Request processed in 108us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744884.301862:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 31 00000100:00100000:3.0:1788744884.301873:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 32 00000100:00100000:3.0:1788744884.301880:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dcb7d04-ec78-42ad-9337-5301be89146f+5:2391:x1875634396740224:12345-192.168.201.46@tcp:9:kworker.0 00000020:00000080:3.0:1788744884.301891:0:18695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc298f6 00000100:00080000:3.0:1788744884.301896:0:18695:0:(import.c:65:import_set_state_nolock()) ffff9ce3ac24f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744884.301917:0:18695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788744884.301965:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dcb7d04-ec78-42ad-9337-5301be89146f+2:2391:x1875634396740224:12345-192.168.201.46@tcp:9:kworker.0 Request processed in 85us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744884.301971:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 32 00000100:00100000:3.0:1788744884.301995:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396739328 00000100:00100000:3.0:1788744884.301999:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396739328 00000100:00100000:3.0:1788744884.302020:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396739968 00000100:00100000:3.0:1788744884.302023:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396739968 00000100:00100000:3.0:1788744884.302050:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396739840 00000100:00100000:3.0:1788744884.302053:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396739840 00000100:00100000:3.0:1788744884.302066:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:3.0:1788744884.302071:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+14:2394:x1875634396739328:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788744884.302101:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+14:2394:x1875634396739328:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 30us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744884.302107:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:3.0:1788744884.302119:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 73 00000100:00100000:3.0:1788744884.302125:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dcb7d04-ec78-42ad-9337-5301be89146f+5:2394:x1875634396739968:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788744884.302146:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dcb7d04-ec78-42ad-9337-5301be89146f+5:2394:x1875634396739968:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 22us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744884.302152:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 73 00000100:00100000:3.0:1788744884.302163:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 74 00000100:00100000:3.0:1788744884.302169:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dcb7d04-ec78-42ad-9337-5301be89146f+6:2394:x1875634396739840:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788744884.302191:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dcb7d04-ec78-42ad-9337-5301be89146f+6:2394:x1875634396739840:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 23us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744884.302196:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 74 00010000:00010000:3.0:1788744884.302305:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744884.302311:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744884.302322:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744884.302325:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788744884.302328:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744884.302329:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788744884.302568:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744884.305981:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744884.306028:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744884.306074:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396739456 00000100:00100000:3.0:1788744884.306084:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396739456 00000100:00100000:2.0:1788744884.306116:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396739200 00000100:00100000:2.0:1788744884.306121:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396739200 00000100:00100000:3.0:1788744884.306154:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 75 00000100:00100000:2.0:1788744884.306154:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 168 00000100:00100000:3.0:1788744884.306163:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+5:2395:x1875634396739456:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788744884.306163:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3afa6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67e7fb34-354b-4792-9dd2-37051f3498dc+13:2395:x1875634396739200:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788744884.306271:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3afa6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67e7fb34-354b-4792-9dd2-37051f3498dc+13:2395:x1875634396739200:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744884.306280:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 168 00000100:00100000:0.0:1788744884.308292:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419886848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744884.308466:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+5:2395:x1875634396739456:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2301us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744884.308476:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 75 00000100:00100000:3.0:1788744884.308523:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419886720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744884.308613:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744884.309274:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419886720 00000100:00100000:1.0:1788744884.309284:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419886720 00000100:00100000:1.0:1788744884.309330:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744884.309340:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419886720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788744884.309380:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788744884.309457:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419886720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744884.309462:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788744884.309765:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744884.309816:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419886848 00000100:00100000:0.0:1788744884.309821:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419886848 00000100:00100000:0.0:1788744884.309845:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788744884.309853:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419886848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744884.309873:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788744884.309908:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419886848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744884.309915:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788744884.309956:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419886848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744884.311194:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419886720:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788744884.368504:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788744885.074553:0:17224:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788744885.074563:0:17224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744885.074583:0:17224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788744885.074591:0:17224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788744885.405372:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744885.713889:0:20564:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 21:34:44 (1788744884) 00000100:00100000:3.0:1788744886.353591:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419886976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744886.353658:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744886.353734:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419886976 00000100:00100000:3.0:1788744886.353743:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419886976 00000100:00100000:3.0:1788744886.353806:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744886.353816:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419886976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744886.353846:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788744886.353890:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419886976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744886.353897:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788744886.353918:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744886.353952:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419886976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744886.355389:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419887360:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.355438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744886.355470:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419887872:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.355489:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744886.355501:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1875634419888384:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.355518:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744886.355545:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788744886.355550:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419887232:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.355650:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419887104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744886.355687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744886.355704:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875634419887616:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.355723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744886.355739:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875634419888128:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.355756:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744886.355782:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419888640:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.355803:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744886.355820:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788744886.355826:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419887488:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.355844:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744886.355860:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419888000:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.355878:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744886.355894:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419888512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.355911:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744886.355940:0:19179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419887872 00000100:00100000:2.0:1788744886.355947:0:19179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419887872 00000100:00100000:2.0:1788744886.355994:0:19179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419887488 00000100:00100000:2.0:1788744886.355998:0:19179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419887488 00000100:00100000:2.0:1788744886.356010:0:19179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419888000 00000100:00100000:2.0:1788744886.356012:0:19179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419888000 00000100:00100000:2.0:1788744886.356026:0:19179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788744886.356034:0:19179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419887872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.356081:0:19179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419887872:12345-0@lo:400:kworker.0 Request processed in 48us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.356089:0:19179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788744886.356107:0:19179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744886.356119:0:19179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419887488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.356148:0:19179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419887488:12345-0@lo:400:kworker.0 Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.356153:0:19179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744886.356164:0:19179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788744886.356169:0:19179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419888000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.356202:0:19179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419888000:12345-0@lo:400:kworker.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.356216:0:19179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788744886.356231:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419888384 00000100:00100000:2.0:1788744886.356235:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419888384 00000100:00100000:2.0:1788744886.356270:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419887616 00000100:00100000:2.0:1788744886.356272:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419887616 00000100:00100000:2.0:1788744886.356282:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419888128 00000100:00100000:2.0:1788744886.356285:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419888128 00000100:00100000:2.0:1788744886.356294:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419888640 00000100:00100000:2.0:1788744886.357451:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419888640 00000100:00100000:2.0:1788744886.357486:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419888512 00000100:00100000:2.0:1788744886.357489:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419888512 00000100:00100000:2.0:1788744886.357505:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744886.357513:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875634419888384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.357675:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744886.357729:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419887744:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.357756:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744886.357785:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419888256:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.357806:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744886.357833:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419887872:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.357878:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419887232 00000100:00100000:0.0:1788744886.357882:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419887232 00000100:00100000:0.0:1788744886.357910:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788744886.357916:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3afa68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+24:3635:x1875634419887232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.357952:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3afa68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+24:3635:x1875634419887232:12345-0@lo:400:kworker.0 Request processed in 35us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744886.357958:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788744886.357988:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419887360 00000100:00100000:0.0:1788744886.357991:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419887360 00000100:00100000:0.0:1788744886.358014:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419887744 00000100:00100000:0.0:1788744886.358016:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419887744 00000100:00100000:0.0:1788744886.358027:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744886.358031:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419887360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.358059:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419887360:12345-0@lo:400:kworker.0 Request processed in 28us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744886.358065:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744886.358076:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788744886.358081:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419887744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.358104:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419887744:12345-0@lo:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744886.358109:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788744886.358148:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419887232:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.358157:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419887744:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.358166:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419887360:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.358385:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875634419888384:12345-0@lo:400:kworker.0 Request processed in 872us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.358393:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744886.358407:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419888256 00000100:00100000:2.0:1788744886.358411:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419888256 00000100:00100000:2.0:1788744886.358429:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788744886.358434:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875634419887616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.358475:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875634419887616:12345-0@lo:400:kworker.0 Request processed in 40us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.358480:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788744886.358492:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788744886.358498:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875634419888128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.358524:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875634419888128:12345-0@lo:400:kworker.0 Request processed in 27us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.358530:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788744886.358543:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788744886.358548:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875634419888640:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788744886.358672:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3a6bb3480 x1875634419888384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744886.358684:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1875634419888384:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.359415:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875634419888640:12345-0@lo:400:kworker.0 Request processed in 865us (3609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.359423:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788744886.359440:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788744886.359448:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875634419888512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.359477:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875634419888512:12345-0@lo:400:kworker.0 Request processed in 31us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.359482:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788744886.359493:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788744886.359498:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419888256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.359544:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419888256:12345-0@lo:400:kworker.0 Request processed in 46us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.359549:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788744886.359703:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744886.359708:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744886.359718:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744886.359720:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744886.359733:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419887104 00000100:00100000:2.0:1788744886.359738:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419887104 00000100:00100000:2.0:1788744886.360385:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744886.360394:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419887104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744886.360412:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788744886.360451:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419887104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (4763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744886.360457:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744886.360501:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419887488:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.360512:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419888000:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.360521:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419888512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.360690:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419887104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744886.360708:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875634419887616:0@lo:400:kworker.0 00000100:00100000:2.0:1788744886.360719:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875634419888128:0@lo:400:kworker.0 00010000:00080000:2.0:1788744886.360731:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3a6bb1f80 x1875634419888640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744886.360742:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419888640:0@lo:400:kworker.0 00000100:00100000:0.0:1788744886.360943:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419888256:0@lo:400:kworker.0 00010000:00010000:1.0:1788744886.416611:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744887.440474:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744887.894351:0:17170:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788744887.894367:0:17170:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1788744887.894522:0:17228:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1788744887.894535:0:17228:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:2.0:1788744888.464536:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744888.912717:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744888.912743:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419888768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744888.912818:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744888.912906:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419888768 00000100:00100000:1.0:1788744888.912916:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419888768 00000100:00100000:1.0:1788744888.912988:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744888.912999:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419888768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744888.913031:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788744888.913081:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419888768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744888.913088:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744888.913134:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419888768:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788744888.913328:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744888.913567:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744888.913578:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419888896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744888.913620:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744888.913693:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419888896 00000100:00100000:2.0:1788744888.913698:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419888896 00000100:00100000:2.0:1788744888.913745:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788744888.913753:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419888896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744888.913766:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788744888.913800:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419888896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744888.913807:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788744888.913896:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744888.913923:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419888896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744889.411689:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744889.411725:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744889.411755:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744889.411769:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744889.411784:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744889.411806:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744889.411829:0:19179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396740736 00000100:00100000:1.0:1788744889.411839:0:19179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396740736 00000100:00100000:1.0:1788744889.411899:0:19179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 37 00000100:00100000:1.0:1788744889.411909:0:19179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbec6146-07af-44eb-a947-059296d3f720+5:2395:x1875634396740736:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1788744889.411980:0:19179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbec6146-07af-44eb-a947-059296d3f720+5:2395:x1875634396740736:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744889.411988:0:19179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 37 00000100:00080000:1.0:1788744889.412111:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744889.412169:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396740608 00000100:00100000:0.0:1788744889.412174:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396740608 00000100:00100000:0.0:1788744889.412203:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396740864 00000100:00100000:0.0:1788744889.412205:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396740864 00000100:00100000:0.0:1788744889.412216:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396740480 00000100:00100000:0.0:1788744889.412217:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396740480 00000100:00100000:0.0:1788744889.412226:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396740992 00000100:00100000:0.0:1788744889.412228:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396740992 00000100:00100000:0.0:1788744889.412239:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 82 00000100:00100000:0.0:1788744889.412295:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+5:2395:x1875634396740608:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1788744889.412331:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+5:2395:x1875634396740608:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 39us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744889.412339:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 82 00000100:00100000:0.0:1788744889.412362:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 83 00000100:00100000:0.0:1788744889.412367:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce28806f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dcb7d04-ec78-42ad-9337-5301be89146f+6:2395:x1875634396740864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1788744889.412391:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce28806f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dcb7d04-ec78-42ad-9337-5301be89146f+6:2395:x1875634396740864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 24us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744889.412415:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 83 00000100:00100000:0.0:1788744889.412432:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 84 00000100:00100000:0.0:1788744889.412438:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+13:2395:x1875634396740480:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1788744889.412463:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+13:2395:x1875634396740480:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744889.412469:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 84 00000100:00100000:0.0:1788744889.412484:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 85 00000100:00100000:0.0:1788744889.412490:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dcb7d04-ec78-42ad-9337-5301be89146f+5:2395:x1875634396740992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1788744889.412516:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0dcb7d04-ec78-42ad-9337-5301be89146f+5:2395:x1875634396740992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 26us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744889.412536:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 85 00000100:00080000:1.0:1788744889.412845:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744889.412849:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744889.413409:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396740352 00000100:00100000:2.0:1788744889.413419:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396740352 00000100:00100000:2.0:1788744889.413469:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 170 00000100:00100000:2.0:1788744889.413478:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3afa68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67e7fb34-354b-4792-9dd2-37051f3498dc+13:2395:x1875634396740352:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788744889.413847:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3afa68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67e7fb34-354b-4792-9dd2-37051f3498dc+13:2395:x1875634396740352:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 43us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744889.413855:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 170 00000100:00100000:3.0:1788744889.425544:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419889024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744889.425620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744889.425771:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419889024 00000100:00100000:0.0:1788744889.425781:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419889024 00000100:00100000:0.0:1788744889.425835:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788744889.425845:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419889024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744889.425885:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744889.425940:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419889024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744889.425948:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744889.426097:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419889024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744889.426376:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419889152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744889.426411:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744889.426780:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419889152 00000100:00100000:0.0:1788744889.426786:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419889152 00000100:00100000:0.0:1788744889.426826:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744889.426835:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419889152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744889.426858:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788744889.426964:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419889152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744889.426971:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788744889.431065:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419889152:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788744889.492793:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744889.493384:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788744889.938534:0:18689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0dcb7d04-ec78-42ad-9337-5301be89146f 00000020:00000080:1.0:1788744889.938552:0:18689:0:(genops.c:885:class_export_put()) final put ffff9ce3af9b3000/0dcb7d04-ec78-42ad-9337-5301be89146f 00000020:00000080:3.0:1788744889.939954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3af9b3000/0dcb7d04-ec78-42ad-9337-5301be89146f for lustre-OST0000 00000020:00000080:3.0:1788744889.940033:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3af9b6800 for lustre-OST0000 00000001:00100000:3.0:1788744889.944887:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0dcb7d04-ec78-42ad-9337-5301be89146f 00000020:00000080:3.0:1788744889.944898:0:19508:0:(genops.c:885:class_export_put()) final put ffff9ce3af9b3800/0dcb7d04-ec78-42ad-9337-5301be89146f 00000001:00100000:3.0:1788744889.944988:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cbec6146-07af-44eb-a947-059296d3f720 00000020:00000080:3.0:1788744889.944991:0:19508:0:(genops.c:885:class_export_put()) final put ffff9ce3bd207000/cbec6146-07af-44eb-a947-059296d3f720 00000020:00000080:0.0:1788744889.949664:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3af9b3800/0dcb7d04-ec78-42ad-9337-5301be89146f for lustre-OST0001 00000020:00000080:0.0:1788744889.949746:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3ac24f000 for lustre-OST0001 00000020:00000080:1.0:1788744889.955526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bd207000/cbec6146-07af-44eb-a947-059296d3f720 for lustre-OST0001 00000020:00000080:1.0:1788744889.955604:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3afaff000 for lustre-OST0001 00000100:00100000:1.0:1788744890.079509:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788744890.079627:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396741248 00000100:00100000:0.0:1788744890.079638:0:17193:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396741248 00000100:00100000:0.0:1788744890.079696:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13 00000100:00100000:0.0:1788744890.079706:0:17193:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbec6146-07af-44eb-a947-059296d3f720+13:16340:x1875634396741248:12345-192.168.201.46@tcp:35:umount.0 00000001:00080000:0.0:1788744890.079989:0:17193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:0.0:1788744890.080375:0:17193:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbec6146-07af-44eb-a947-059296d3f720+15:16340:x1875634396741248:12345-192.168.201.46@tcp:35:umount.0 Request processed in 668us (876us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1788744890.080384:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13 00000020:00080000:0.0:1788744890.080390:0:17193:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788744890.090573:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788744890.090624:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744890.091010:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396741504 00000100:00100000:3.0:1788744890.091032:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396741504 00000100:00100000:3.0:1788744890.091168:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396741376 00000100:00100000:3.0:1788744890.091173:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396741376 00000100:00100000:0.0:1788744890.091355:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788744890.097021:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788744890.097057:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396741760 00000100:00100000:0.0:1788744890.097068:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396741760 00000100:00100000:0.0:1788744890.097137:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 33 00000100:00100000:0.0:1788744890.097149:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbec6146-07af-44eb-a947-059296d3f720+5:2391:x1875634396741760:12345-192.168.201.46@tcp:9:umount.0 00000020:00000080:0.0:1788744890.097206:0:18695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc298b0 00000100:00080000:0.0:1788744890.097219:0:18695:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd200800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744890.097285:0:18695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788744890.099574:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbec6146-07af-44eb-a947-059296d3f720+2:2391:x1875634396741760:12345-192.168.201.46@tcp:9:umount.0 Request processed in 2418us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744890.099605:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 33 00000100:00100000:2.0:1788744890.103833:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396741632 00000100:00100000:2.0:1788744890.103849:0:18718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396741632 00000100:00100000:2.0:1788744890.103933:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3 00000100:00100000:2.0:1788744890.103945:0:18718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67e7fb34-354b-4792-9dd2-37051f3498dc+15:2394:x1875634396741504:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744890.103963:0:18718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744890.103983:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3bd33e600/0x6e465a23bbc29894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa5734139442199b expref: 15 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744890.104000:0:18718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744890.104889:0:18718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67e7fb34-354b-4792-9dd2-37051f3498dc+14:2394:x1875634396741504:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 943us (14324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744890.104914:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3 00000100:00100000:2.0:1788744890.104948:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 4 00000100:00100000:2.0:1788744890.104957:0:18718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd395850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67e7fb34-354b-4792-9dd2-37051f3498dc+13:2394:x1875634396741376:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744890.104969:0:18718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744890.104983:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3bd33e200/0x6e465a23bbc2988d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa5734139442196a expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744890.104995:0:18718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744890.105593:0:18718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd395850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67e7fb34-354b-4792-9dd2-37051f3498dc+12:2394:x1875634396741376:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 57us (14388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744890.105602:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 4 00000100:00100000:2.0:1788744890.105663:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5 00000100:00100000:2.0:1788744890.105671:0:18718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67e7fb34-354b-4792-9dd2-37051f3498dc+11:2394:x1875634396741632:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744890.105683:0:18718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744890.105708:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421a51 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744890.105720:0:18718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744890.105745:0:18718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67e7fb34-354b-4792-9dd2-37051f3498dc+10:2394:x1875634396741632:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 75us (14392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744890.105751:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5 00010000:00010000:2.0:1788744890.105903:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744890.123286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788744890.123388:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396742656 00000100:00100000:2.0:1788744890.123400:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396742656 00000100:00100000:2.0:1788744890.123463:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 67 00000100:00100000:2.0:1788744890.123473:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+15:2391:x1875634396742656:12345-192.168.201.46@tcp:39:umount.0 00000020:00000080:2.0:1788744890.123521:0:20327:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc298a2 00000020:00010000:2.0:1788744890.123538:0:20327:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ce287b48800: total 0 00000100:00080000:2.0:1788744890.123544:0:20327:0:(import.c:65:import_set_state_nolock()) ffff9ce390269000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744890.123580:0:20327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:2.0:1788744890.123771:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbec6146-07af-44eb-a947-059296d3f720+14:2391:x1875634396742656:12345-192.168.201.46@tcp:39:umount.0 Request processed in 298us (536us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788744890.123780:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 67 00000020:00010000:0.0:1788744890.125336:0:17178:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ce287b48800: total 0 00010000:00010000:0.0:1788744890.125427:0:17178:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ce287b48800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788744890.125468:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ce3af9f1100) 00010000:00010000:0.0:1788744890.125473:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744890.125485:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce381490a00/0x6e465a23bbc29b57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421aeb expref: 13 pid: 20029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744890.125516:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce3a3269d00) 00010000:00010000:0.0:1788744890.125520:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744890.125525:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2000/0x6e465a23bbc2996d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421a58 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744890.125540:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ce3a3269600) 00010000:00010000:0.0:1788744890.125543:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788744890.125547:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce381491600/0x6e465a23bbc29a4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421a97 expref: 11 pid: 20029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744890.125593:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ce3a3269f00) 00010000:00010000:0.0:1788744890.125595:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744890.125600:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f200/0x6e465a23bbc29afc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421ad6 expref: 10 pid: 20327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744890.125613:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ce3a3269f00) 00010000:00010000:0.0:1788744890.125615:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744890.125618:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ea00/0x6e465a23bbc29acb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421ac1 expref: 9 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744890.125645:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3af9f1300) 00010000:00010000:0.0:1788744890.125647:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744890.125651:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2e00/0x6e465a23bbc299c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421a6d expref: 8 pid: 20029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744890.125662:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ce3a3269f00) 00010000:00010000:0.0:1788744890.125664:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744890.125668:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920a00/0x6e465a23bbc29bb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b0e expref: 7 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744890.125682:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce3895e9a00) 00010000:00010000:0.0:1788744890.125684:0:17178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744890.125687:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921000/0x6e465a23bbc29989 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421a5f expref: 6 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744890.125715:0:17178:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ce287b48800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1788744890.125732:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744890.125734:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744890.125736:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744890.151562:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788744890.151845:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396742784 00000100:00100000:3.0:1788744890.151857:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396742784 00000100:00100000:3.0:1788744890.151925:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 68 00000100:00100000:3.0:1788744890.151936:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbec6146-07af-44eb-a947-059296d3f720+5:2391:x1875634396742784:12345-192.168.201.46@tcp:39:umount.0 00000020:00000080:3.0:1788744890.151971:0:17191:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc298a9 00000100:00080000:3.0:1788744890.151990:0:17191:0:(import.c:65:import_set_state_nolock()) ffff9ce3c195d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744890.152160:0:17191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788744890.152845:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbec6146-07af-44eb-a947-059296d3f720+3:2391:x1875634396742784:12345-192.168.201.46@tcp:39:umount.0 Request processed in 909us (1292us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788744890.152862:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 68 00010000:00010000:1.0:1788744890.161442:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744890.516354:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744891.472995:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419889408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.473005:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419889536:0@lo:400:kworker.0 00000100:00100000:3.0:1788744891.473152:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3634:1875634419889280:0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.474323:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419889664:0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.477703:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744891.477788:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419890048:0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.477828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744891.477848:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419890560:0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.477873:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744891.477916:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419891072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788744891.477943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744891.478708:0:19179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419889536 00000100:00100000:0.0:1788744891.478718:0:19179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419889536 00000100:00100000:0.0:1788744891.478779:0:19179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419890048 00000100:00100000:0.0:1788744891.478783:0:19179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419890048 00000100:00100000:0.0:1788744891.478805:0:19179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744891.478814:0:19179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419889536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.478876:0:19179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419889536:12345-0@lo:400:kworker.0 Request processed in 62us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744891.478883:0:19179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744891.478908:0:19179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744891.478914:0:19179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419890048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744891.479149:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744891.479188:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419889920:0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.479629:0:19179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419890048:12345-0@lo:400:kworker.0 Request processed in 714us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744891.479638:0:19179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744891.479702:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419889536:0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.479713:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419890048:0@lo:400:kworker.0 00000100:00080000:0.0:1788744891.479763:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744891.479784:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419889408 00000100:00100000:0.0:1788744891.479789:0:20328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419889408 00000100:00100000:0.0:1788744891.479818:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744891.479824:0:20328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419889408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.479863:0:20328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419889408:12345-0@lo:400:kworker.0 Request processed in 39us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744891.479869:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744891.479915:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419890560 00000100:00100000:0.0:1788744891.479919:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419890560 00000100:00100000:0.0:1788744891.479964:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788744891.479972:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419890560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.480011:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419890560:12345-0@lo:400:kworker.0 Request processed in 40us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744891.480017:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788744891.480033:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788744891.480052:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3c1ad9880 x1875634419890560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744891.480064:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419890560:0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.480324:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744891.480375:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419890176:0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.480404:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744891.480421:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419890688:0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.480445:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744891.480480:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419891072 00000100:00100000:2.0:1788744891.480485:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419891072 00000100:00100000:2.0:1788744891.480520:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744891.480527:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419891072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744891.480552:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788744891.480587:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419891072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744891.480594:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744891.480615:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419890688 00000100:00100000:2.0:1788744891.480618:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419890688 00000100:00100000:2.0:1788744891.480638:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788744891.480650:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875634419890688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.480676:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875634419890688:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744891.480681:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788744891.480712:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419890688:0@lo:400:kworker.0 00000100:00080000:2.0:1788744891.480740:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744891.480743:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744891.480751:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419889664 00000100:00100000:2.0:1788744891.480754:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419889664 00000100:00100000:2.0:1788744891.480778:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419890176 00000100:00100000:2.0:1788744891.480780:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419890176 00000100:00100000:2.0:1788744891.480987:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744891.480993:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419889664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.481020:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419889664:12345-0@lo:400:kworker.0 Request processed in 28us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744891.481024:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744891.481032:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744891.481035:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419890176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.481050:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419890176:12345-0@lo:400:kworker.0 Request processed in 15us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744891.481053:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788744891.481063:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744891.481074:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419889664:0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.481080:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419890176:0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.481137:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419891072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744891.490461:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744891.490825:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419890432:0@lo:400:kworker.0 00000100:00100000:1.0:1788744891.490880:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744891.490925:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419890944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744891.490952:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419890432 00000100:00100000:1.0:1788744891.490958:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744891.490963:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419890432 00000100:00100000:1.0:1788744891.491014:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419889408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.491036:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788744891.491048:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419890432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744891.491050:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419890944 00000100:00100000:1.0:1788744891.491056:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419890944 00000100:00100000:1.0:1788744891.491090:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744891.491112:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419890944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744891.491126:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419890432:12345-0@lo:400:kworker.0 Request processed in 80us (244us total) trans 0 rc 0/0 00002000:00000024:1.0:1788744891.491131:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788744891.491137:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744891.491171:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419890944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (212us total) trans 0 rc 0/0 00000100:00080000:0.0:1788744891.491174:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744891.491179:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744891.491224:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419890944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744891.491235:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419890432:0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.493916:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419889920 00000100:00100000:2.0:1788744891.493931:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419889920 00000100:00100000:2.0:1788744891.494008:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744891.494019:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419889920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.494125:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419889920:12345-0@lo:400:kworker.0 Request processed in 107us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744891.494132:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744891.495065:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419889920:0@lo:400:kworker.0 00000100:00100000:3.0:1788744891.496162:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744891.496235:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419889280 00000100:00100000:0.0:1788744891.496276:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419889280 00000100:00100000:0.0:1788744891.496334:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788744891.496344:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3afa6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+24:3634:x1875634419889280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.496404:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3afa6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+24:3634:x1875634419889280:12345-0@lo:400:kworker.0 Request processed in 63us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744891.496413:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788744891.499281:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419889792:0@lo:400:kworker.0 00000100:00100000:3.0:1788744891.499359:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744891.499414:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419890304:0@lo:400:kworker.0 00000100:00100000:3.0:1788744891.499437:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744891.499466:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419890816:0@lo:400:kworker.0 00000100:00100000:3.0:1788744891.499486:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744891.499522:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419889792 00000100:00100000:3.0:1788744891.499542:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3634:1875634419889280:0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.499543:0:17189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419889792 00000100:00100000:0.0:1788744891.499581:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419890304 00000100:00100000:0.0:1788744891.499584:0:17189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419890304 00000100:00100000:3.0:1788744891.499596:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419890816 00000100:00100000:3.0:1788744891.499599:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419890816 00000100:00100000:0.0:1788744891.499608:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788744891.499615:0:17189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419889792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744891.499628:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788744891.499632:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419890304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.499759:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788744891.499767:0:17189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419889792:12345-0@lo:400:kworker.0 Request processed in 153us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744891.499769:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875634419890816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744891.499775:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788744891.502146:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419890304:12345-0@lo:400:kworker.0 Request processed in 2504us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744891.502159:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788744891.502211:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788744891.502341:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419889792:0@lo:400:kworker.0 00000100:00100000:3.0:1788744891.502360:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419890304:0@lo:400:kworker.0 00000100:00100000:2.0:1788744891.502532:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875634419890816:12345-0@lo:400:kworker.0 Request processed in 2764us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744891.502540:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1788744891.509805:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3c1ad9500 x1875634419890816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744891.509824:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419890816:0@lo:400:kworker.0 00010000:00010000:0.0:1788744891.537903:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744892.150146:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744892.150196:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744892.150230:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788744892.150368:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396743040 00000100:00100000:0.0:1788744892.150381:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396743040 00000100:00100000:0.0:1788744892.150458:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396742912 00000100:00100000:0.0:1788744892.150462:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396742912 00000100:00100000:0.0:1788744892.150476:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396743168 00000100:00100000:0.0:1788744892.150479:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396743168 00000100:00100000:0.0:1788744892.150497:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 6 00000100:00100000:0.0:1788744892.150505:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1aced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67e7fb34-354b-4792-9dd2-37051f3498dc+12:2395:x1875634396743040:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744892.150522:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744892.150540:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3bd33f000/0x6e465a23bbc298d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421a0b expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744892.150573:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744892.150639:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1aced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67e7fb34-354b-4792-9dd2-37051f3498dc+11:2395:x1875634396743040:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 133us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744892.150647:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 6 00000100:00100000:0.0:1788744892.150700:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00100000:0.0:1788744892.150708:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67e7fb34-354b-4792-9dd2-37051f3498dc+10:2394:x1875634396742912:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744892.150716:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744892.151365:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287b12800/0x6e465a23bbc298cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa573413944219da expref: 10 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744892.151378:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744892.151406:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67e7fb34-354b-4792-9dd2-37051f3498dc+9:2394:x1875634396742912:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 699us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744892.151413:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00100000:0.0:1788744892.151439:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8 00000100:00100000:0.0:1788744892.151447:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67e7fb34-354b-4792-9dd2-37051f3498dc+8:2394:x1875634396743168:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744892.151456:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744892.151466:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce28804f800/0x6e465a23bbc2994a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421a4a expref: 8 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744892.151475:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744892.151492:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67e7fb34-354b-4792-9dd2-37051f3498dc+7:2394:x1875634396743168:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 46us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744892.151498:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8 00000100:00100000:0.0:1788744892.156963:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788744892.157237:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396743424 00000100:00100000:1.0:1788744892.157282:0:17189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396743424 00000100:00100000:1.0:1788744892.157338:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00100000:1.0:1788744892.157348:0:17189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dcb7d04-ec78-42ad-9337-5301be89146f+6:2391:x1875634396743424:12345-192.168.201.46@tcp:39:umount.0 00000020:00000080:1.0:1788744892.157384:0:17189:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc298e8 00000020:00010000:1.0:1788744892.157391:0:17189:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ce285a48800: total 0 00000100:00080000:1.0:1788744892.157395:0:17189:0:(import.c:65:import_set_state_nolock()) ffff9ce285a4c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744892.157417:0:17189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788744892.157574:0:17189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dcb7d04-ec78-42ad-9337-5301be89146f+5:2391:x1875634396743424:12345-192.168.201.46@tcp:39:umount.0 Request processed in 226us (621us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788744892.157582:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00080000:3.0:1788744892.157851:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788744892.157889:0:19391:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ce285a48800: total 0 00010000:00010000:3.0:1788744892.157894:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744892.157958:0:19391:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ce285a48800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788744892.158018:0:19391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3af9f1300) 00010000:00010000:3.0:1788744892.158023:0:19391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744892.158034:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3e00/0x6e465a23bbc299d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421a74 expref: 4 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744892.158064:0:19391:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ce285a48800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788744892.158074:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744892.158076:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744892.158078:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744892.179382:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788744892.179789:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396743552 00000100:00100000:0.0:1788744892.179802:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396743552 00000100:00100000:0.0:1788744892.180091:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00100000:0.0:1788744892.180104:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dcb7d04-ec78-42ad-9337-5301be89146f+5:2391:x1875634396743552:12345-192.168.201.46@tcp:39:umount.0 00000020:00000080:0.0:1788744892.180152:0:17190:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc298e1 00000100:00080000:0.0:1788744892.180163:0:17190:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd10f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744892.180194:0:17190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788744892.180388:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dcb7d04-ec78-42ad-9337-5301be89146f+3:2391:x1875634396743552:12345-192.168.201.46@tcp:39:umount.0 Request processed in 286us (1017us total) trans 8589934594 rc 0/0 00010000:00010000:2.0:1788744892.180952:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744892.181076:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00080000:3.0:1788744892.181484:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744892.225702:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788744892.227285:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396743808 00000100:00100000:2.0:1788744892.227298:0:17183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396743808 00000100:00100000:2.0:1788744892.227356:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 172 00000100:00100000:2.0:1788744892.227366:0:17183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3afa6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67e7fb34-354b-4792-9dd2-37051f3498dc+7:2391:x1875634396743808:12345-192.168.201.46@tcp:251:umount.0 00000020:00000080:2.0:1788744892.227417:0:17183:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2987f 00000020:00010000:2.0:1788744892.227424:0:17183:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ce286b69000: total 0 00000100:00080000:2.0:1788744892.227430:0:17183:0:(import.c:65:import_set_state_nolock()) ffff9ce286b6c000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788744892.227497:0:17178:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ce286b69000: total 0 00000100:00100000:2.0:1788744892.227516:0:17183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3afa6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67e7fb34-354b-4792-9dd2-37051f3498dc+3:2391:x1875634396743808:12345-192.168.201.46@tcp:251:umount.0 Request processed in 151us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744892.227523:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 172 00010000:00010000:0.0:1788744892.227562:0:17178:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ce286b69000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788744892.228837:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287b13400/0x6e465a23bbc29886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421963 expref: 2 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744892.228989:0:17178:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ce286b69000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788744892.229150:0:17178:0:(genops.c:885:class_export_put()) final put ffff9ce286b69000/67e7fb34-354b-4792-9dd2-37051f3498dc 00010000:00010000:1.0:1788744892.229196:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744892.229208:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744892.229211:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788744892.229382:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce286b69000/67e7fb34-354b-4792-9dd2-37051f3498dc for MGS 00000020:00000080:0.0:1788744892.229574:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce286b6c000 for MGS 00010000:00010000:1.0:1788744892.561703:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744893.587864:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744894.039649:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419891200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744894.039727:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744894.039840:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419891200 00000100:00100000:0.0:1788744894.039848:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419891200 00000100:00100000:0.0:1788744894.039903:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744894.039912:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419891200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744894.039941:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788744894.039998:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419891200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744894.040005:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744894.040065:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419891200:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788744894.040175:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744894.040495:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419891328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744894.040527:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744894.040634:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419891328 00000100:00100000:2.0:1788744894.040640:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419891328 00000100:00100000:2.0:1788744894.040685:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744894.040707:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419891328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744894.040721:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788744894.040756:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419891328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744894.040762:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788744894.040798:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744894.040816:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419891328:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1788744894.105834:0:20760:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788744894.131157:0:20760:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788744894.131223:0:20760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.131238:0:20760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.131283:0:20760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.131291:0:20760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.131306:0:20760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744894.131311:0:20760:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788744894.131337:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744894.131341:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788744894.131348:0:20760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788744894.131374:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd10a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788744894.131441:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875634419891456:0@lo:39:umount.0 00000100:00100000:0.0:1788744894.131525:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744894.131615:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744894.131623:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.131631:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287b12a00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744894.131650:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.131658:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744894.131665:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744894.131671:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744894.131673:0:17178:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788744894.131676:0:17178:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788744894.131703:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.131710:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744894.131732:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.131740:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287b12a00/0x6e465a23bbc29442 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29449 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.131751:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744894.131753:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744894.131754:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744894.131766:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419891584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744894.131798:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744894.131859:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419891584 00000100:00100000:1.0:1788744894.131867:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419891584 00000100:00100000:1.0:1788744894.131918:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744894.131927:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+24:3635:x1875634419891584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744894.131950:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744894.131964:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3bd33e400/0x6e465a23bbc29449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29442 expref: 24 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.132387:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744894.132434:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+23:3635:x1875634419891584:12345-0@lo:103:ldlm_bl.0 Request processed in 506us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744894.132441:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744894.133732:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419891584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744894.133909:0:20327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419891456 00000100:00100000:1.0:1788744894.133917:0:20327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419891456 00000100:00100000:1.0:1788744894.133992:0:20327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788744894.134001:0:20327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875634419891456:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788744894.134036:0:20327:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29473 00000100:00080000:1.0:1788744894.134044:0:20327:0:(import.c:65:import_set_state_nolock()) ffff9ce3bf88a000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788744894.134281:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744894.134797:0:20327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3633:x1875634419891456:12345-0@lo:39:umount.0 Request processed in 795us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744894.134808:0:20327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1788744894.134819:0:20327:0:(genops.c:885:class_export_put()) final put ffff9ce3bf88d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788744894.134887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bf88d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788744894.134951:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3bf88a000 for lustre-MDT0000 00000100:00080000:0.0:1788744894.135089:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd10a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788744894.135109:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875634419891456:0@lo:39:umount.0 00000100:00080000:2.0:1788744894.135165:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744894.135169:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788744894.135815:0:20760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788744894.137149:0:20760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.137165:0:20760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.137172:0:20760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.137178:0:20760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.137601:0:20760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744894.137611:0:20760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.137618:0:20760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.137625:0:20760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.137631:0:20760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.137659:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744894.137667:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.137691:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33f400 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:3.0:1788744894.137695:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.137703:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744894.137709:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744894.137715:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744894.137718:0:17179:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788744894.137752:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.137759:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788744894.137821:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3636:1875634419891712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744894.137890:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744894.137995:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419891712 00000100:00100000:1.0:1788744894.138003:0:17175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419891712 00000100:00100000:1.0:1788744894.138065:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744894.138075:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+23:3636:x1875634419891712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744894.138088:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744894.138103:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3bd33ee00/0x6e465a23bbc2939a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29393 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.138119:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744894.138173:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.138180:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc29393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2939a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.138201:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744894.138204:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.138209:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804f600 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:3.0:1788744894.138212:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.138228:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744894.138234:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744894.138238:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744894.138240:0:17179:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788744894.138279:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.138286:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744894.138990:0:20760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1788744894.138998:0:20760:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788744894.139012:0:20760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.139035:0:20760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.139041:0:20760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.139056:0:20760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.139070:0:20760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744894.139075:0:20760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.139081:0:20760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.139086:0:20760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.139091:0:20760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744894.139097:0:20760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788744894.139100:0:20760:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788744894.139103:0:20760:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788744894.139143:0:20760:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788744894.139147:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788744894.139151:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744894.139158:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788744894.139168:0:20760:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce3afafc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744894.139173:0:20760:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce285a11000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744894.139177:0:20760:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce394688800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744894.139181:0:20760:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ce287736800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744894.139196:0:20760:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9ce285a48800 0dcb7d04-ec78-42ad-9337-5301be89146f 192.168.201.46@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788744894.139201:0:20760:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9ce287b48800 cbec6146-07af-44eb-a947-059296d3f720 192.168.201.46@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1788744894.139207:0:20760:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9ce28660cd40) has exports, disconnecting them 00000020:00080000:2.0:1788744894.139211:0:20760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce3afafc000), last request at 1788744891 00000020:00000080:2.0:1788744894.139218:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2976e 00000100:00080000:2.0:1788744894.139236:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce3afafc800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788744894.139302:0:20760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce3afafc000): rc 0 00000020:00000080:2.0:1788744894.139305:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3afafc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788744894.139315:0:20760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce285a11000), last request at 1788744891 00000020:00000080:2.0:1788744894.139318:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29610 00000100:00080000:2.0:1788744894.139323:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce285a15000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788744894.139330:0:20760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce285a11000): rc 0 00000020:00000080:2.0:1788744894.139331:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce285a11000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788744894.139335:0:20760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce394688800), last request at 1788744817 00000020:00000080:2.0:1788744894.139338:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29561 00000100:00080000:2.0:1788744894.139340:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce39468b000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788744894.139345:0:20760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce394688800): rc 0 00000020:00000080:2.0:1788744894.139347:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce394688800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788744894.139350:0:20760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ce287736800), last request at 1788744817 00000020:00000080:2.0:1788744894.139353:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29506 00000100:00080000:2.0:1788744894.139355:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce286b6d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744894.139360:0:20760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00080000:2.0:1788744894.139448:0:20760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce287736800): rc 0 00000004:00000080:2.0:1788744894.139455:0:20760:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab0840d1fae0 00000100:00080000:2.0:1788744894.139474:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788744894.139478:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788744894.140314:0:20760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788744894.140341:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd10e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788744894.140492:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788744894.140496:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788744894.140508:0:20760:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788744894.140573:0:20760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788744894.140583:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce285a4f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788744894.140589:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788744894.140592:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788744894.140601:0:20760:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788744894.140665:0:20760:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788744894.140673:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce392b82000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788744894.140711:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ce28660cd40) has no exports 00000100:00100000:1.0:1788744894.142267:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+22:3636:x1875634419891712:12345-0@lo:103:ldlm_bl.0 Request processed in 4168us (4350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744894.142300:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:00000080:1.0:1788744894.142347:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3afafc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788744894.142405:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce285a11000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788744894.142428:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce394688800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788744894.142449:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3afafc800 for lustre-MDT0000 00000020:00000080:1.0:1788744894.142454:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce285a15000 for lustre-MDT0000 00000020:00000080:1.0:1788744894.142457:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce39468b000 for lustre-MDT0000 00010000:00010000:1.0:1788744894.142470:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744894.142478:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142500:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804fa00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744894.142505:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142515:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744894.142523:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744894.142529:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788744894.142532:0:17178:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788744894.142535:0:17178:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788744894.142569:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142575:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744894.142597:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142610:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce28804fa00/0x6e465a23bbc2993c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29943 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142621:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744894.142625:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142630:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33e000 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744894.142633:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142639:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744894.142644:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744894.142649:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744894.142651:0:17178:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788744894.142653:0:17178:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788744894.142666:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142670:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744894.142676:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142682:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33e000/0x6e465a23bbc29385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2938c expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.142701:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744894.142703:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744894.142704:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744894.142719:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419892480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744894.142782:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744894.142824:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744894.142831:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419892352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744894.142853:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744894.142881:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419892480 00000100:00100000:1.0:1788744894.142888:0:18718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419892480 00000100:00100000:1.0:1788744894.142926:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419892352 00000100:00100000:1.0:1788744894.142929:0:18718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419892352 00000100:00100000:1.0:1788744894.142947:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744894.142955:0:18718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd396050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+23:3635:x1875634419892480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744894.142966:0:18718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744894.142994:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce28804e000/0x6e465a23bbc2938c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29385 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.143007:0:18718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744894.143039:0:18718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd396050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+22:3635:x1875634419892480:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744894.143045:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744894.143096:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744894.143102:0:18718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ace680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+21:3635:x1875634419892352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744894.143110:0:18718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744894.143119:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce381491200/0x6e465a23bbc29943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc2993c expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744894.143134:0:18718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744894.143157:0:18718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ace680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+20:3635:x1875634419892352:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744894.143163:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744894.143196:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419892352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744894.143204:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419892480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744894.143526:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419891968:0@lo:39:umount.0 00000100:00100000:1.0:1788744894.143564:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744894.143590:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419892096:0@lo:9:umount.0 00000100:00100000:1.0:1788744894.143613:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744894.143635:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419892224:0@lo:9:umount.0 00000100:00100000:1.0:1788744894.143657:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744894.143692:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419891968 00000100:00100000:1.0:1788744894.143698:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419891968 00000100:00100000:1.0:1788744894.143732:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744894.143739:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875634419891968:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788744894.143768:0:17194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2958b 00000100:00080000:1.0:1788744894.143778:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9ce288110000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744894.143805:0:17194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788744894.143933:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3633:x1875634419891968:12345-0@lo:39:umount.0 Request processed in 193us (367us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788744894.143940:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744894.143962:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419892096 00000100:00100000:1.0:1788744894.143966:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419892096 00000100:00100000:1.0:1788744894.144210:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419892224 00000100:00100000:1.0:1788744894.144214:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419892224 00000100:00100000:1.0:1788744894.144787:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744894.144798:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875634419892096:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744894.144819:0:18693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29656 00000100:00080000:1.0:1788744894.144826:0:18693:0:(import.c:65:import_set_state_nolock()) ffff9ce287a2d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744894.144869:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788744894.145128:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3633:x1875634419892096:12345-0@lo:9:umount.0 Request processed in 182us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744894.145136:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744894.145154:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744894.145161:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875634419892224:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744894.145173:0:18693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc297ad 00000100:00080000:1.0:1788744894.145178:0:18693:0:(import.c:65:import_set_state_nolock()) ffff9ce3afafe000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744894.145197:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788744894.145369:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3633:x1875634419892224:12345-0@lo:9:umount.0 Request processed in 209us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744894.145374:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788744894.145406:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788744894.145420:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744894.145450:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd10e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788744894.145457:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419891968:0@lo:39:umount.0 00000100:00080000:1.0:1788744894.145468:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce285a4f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788744894.145524:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:3.0:1788744894.145589:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.145598:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce28804f600/0x6e465a23bbc2979f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc297a6 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.145611:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744894.145613:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744894.145614:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744894.145630:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3637:1875634419891840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744894.145670:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744894.145790:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419891840 00000100:00100000:3.0:1788744894.145795:0:18718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419891840 00000100:00100000:3.0:1788744894.145832:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744894.145838:0:18718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+20:3637:x1875634419891840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744894.145848:0:18718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744894.145875:0:18718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce28804e400/0x6e465a23bbc297a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc2979f expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744894.145886:0:18718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744894.145915:0:18718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13868c1b-1e71-41ca-a26c-b8c8bf9c503a+19:3637:x1875634419891840:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744894.145921:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744894.145950:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3637:1875634419891840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744894.145974:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744894.146552:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3636:1875634419891712:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1788744894.146937:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744894.146944:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419892096:0@lo:9:umount.0 00000100:00080000:1.0:1788744894.146965:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce392b82000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788744894.147090:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788744894.147093:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744894.147096:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419892224:0@lo:9:umount.0 00000020:00080000:3.0:1788744894.154977:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ce28660cd40) has no exports 00000020:00000080:3.0:1788744894.196755:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc293e0 00000020:00000080:3.0:1788744894.196773:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3bd109800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788744894.196836:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788744894.196919:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744894.196930:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788744894.196935:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9ce287624d40) has no exports 00000020:00000080:2.0:1788744894.197566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bd109800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788744894.197628:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc293d9 00000020:00000080:0.0:1788744894.197635:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce392b05000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788744894.197694:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce392b05000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788744894.199155:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744894.199168:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788744894.199174:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3c195a000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788744894.199177:0:20760:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3c195a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788744894.199189:0:20760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1788744894.544879:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744894.544903:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419892608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744894.544994:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744894.545271:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419892608 00000100:00100000:1.0:1788744894.545280:0:20328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419892608 00000100:00100000:1.0:1788744894.545336:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788744894.545344:0:20328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875634419892608:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788744894.545351:0:20328:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788744894.545406:0:20328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875634419892608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (412us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788744894.545413:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:02020000:3.0:1788744894.545491:0:3637:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788744894.555366:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788744894.555375:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ce394382000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788744894.555379:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788744894.563013:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ce394382000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744894.563027:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:3.0:1788744894.563056:0:3637:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce394382000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744894.563099:0:3637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb0a80 x1875634419892736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744894.563396:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419892736:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788744894.563464:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744894.563869:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419892736 00000100:00100000:2.0:1788744894.563878:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419892736 00000100:00100000:2.0:1788744894.563930:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788744894.563938:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419892736:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788744894.563956:0:17195:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788744894.569385:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419892736:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 5442us (5915us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744894.569413:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788744894.570479:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce394382000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744894.570486:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744894.570491:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419892736:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788744894.608699:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744895.632544:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788744896.083420:0:17921:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788744896.083442:0:17921:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788744896.083447:0:17921:0:(genops.c:885:class_export_put()) final put ffff9ce3c18ff000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788744896.083472:0:17921:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0dcb7d04-ec78-42ad-9337-5301be89146f 00000001:00080000:3.0:1788744896.083485:0:17921:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788744896.083487:0:17921:0:(genops.c:885:class_export_put()) final put ffff9ce287ae8800/0dcb7d04-ec78-42ad-9337-5301be89146f 00000001:00100000:3.0:1788744896.083495:0:17921:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cbec6146-07af-44eb-a947-059296d3f720 00000001:00080000:3.0:1788744896.083499:0:17921:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788744896.083501:0:17921:0:(genops.c:885:class_export_put()) final put ffff9ce39026d000/cbec6146-07af-44eb-a947-059296d3f720 00000020:00000080:2.0:1788744896.083559:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3c18ff000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788744896.083620:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287ae8800/0dcb7d04-ec78-42ad-9337-5301be89146f for lustre-MDT0001 00000020:00000080:2.0:1788744896.083643:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce39026d000/cbec6146-07af-44eb-a947-059296d3f720 for lustre-MDT0001 00000020:00000080:2.0:1788744896.083664:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce288110000 for lustre-MDT0001 00000020:00000080:2.0:1788744896.083668:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3bd10f800 for lustre-MDT0001 00000020:00000080:2.0:1788744896.083671:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3c195d000 for lustre-MDT0001 00000001:00100000:0.0:1788744896.084390:0:18689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744896.084396:0:18689:0:(genops.c:885:class_export_put()) final put ffff9ce287a2a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788744896.084411:0:18689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cbec6146-07af-44eb-a947-059296d3f720 00000020:00000080:0.0:1788744896.084414:0:18689:0:(genops.c:885:class_export_put()) final put ffff9ce3bd205000/cbec6146-07af-44eb-a947-059296d3f720 00000020:00000080:1.0:1788744896.085461:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287a2a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788744896.085518:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bd205000/cbec6146-07af-44eb-a947-059296d3f720 for lustre-OST0000 00000020:00000080:1.0:1788744896.085539:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce287a2d800 for lustre-OST0000 00000020:00000080:1.0:1788744896.085543:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3bd200800 for lustre-OST0000 00000001:00100000:1.0:1788744896.088309:0:17170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788744896.088319:0:17170:0:(genops.c:885:class_export_put()) final put ffff9ce287736800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788744896.088349:0:17170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0dcb7d04-ec78-42ad-9337-5301be89146f 00000001:00080000:1.0:1788744896.088358:0:17170:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1788744896.088361:0:17170:0:(genops.c:885:class_export_put()) final put ffff9ce285a48800/0dcb7d04-ec78-42ad-9337-5301be89146f 00000001:00100000:1.0:1788744896.088366:0:17170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cbec6146-07af-44eb-a947-059296d3f720 00000001:00080000:1.0:1788744896.088369:0:17170:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:1.0:1788744896.088382:0:17170:0:(genops.c:885:class_export_put()) final put ffff9ce287b48800/cbec6146-07af-44eb-a947-059296d3f720 00000020:00000080:2.0:1788744896.088533:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287736800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788744896.088605:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce285a48800/0dcb7d04-ec78-42ad-9337-5301be89146f for lustre-MDT0000 00000020:00000080:2.0:1788744896.088631:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287b48800/cbec6146-07af-44eb-a947-059296d3f720 for lustre-MDT0000 00000020:00000080:2.0:1788744896.088652:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce286b6d800 for lustre-MDT0000 00000020:00000080:2.0:1788744896.088657:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce285a4c800 for lustre-MDT0000 00000020:00000080:2.0:1788744896.088660:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce390269000 for lustre-MDT0000 00000020:01000000:0.0:1788744896.208431:0:20760:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce3bcf050c0 - data ffff9ce38f58ea20/ffff9ce3ac271000 00000020:01000000:0.0:1788744896.208613:0:20760:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce2879bd540 - data ffff9ce38f5b2a20/ffff9ce3a62f3c00 00000001:00000004:0.0:1788744896.221724:0:20760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:1.0:1788744896.274878:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788744896.274886:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788744896.274914:0:20760:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ce3b405d500 x1875634419891968/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788744904 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744896.275278:0:20760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788744896.278046:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788744896.278062:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788744896.278087:0:20760:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744896.278090:0:20760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788744896.278444:0:17213:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788744896.278451:0:17213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1788744896.278462:0:17213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788744896.279081:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788744896.279085:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788744896.279100:0:20760:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744896.279102:0:20760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788744896.279711:0:17215:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788744896.279715:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1788744896.279741:0:17215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788744896.280991:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc293a8 00000020:00000080:1.0:1788744896.281001:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce2880e8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744896.281064:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce2880e8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788744896.282303:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc293bd 00000020:00000080:1.0:1788744896.282314:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce287940000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788744896.282334:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788744896.282339:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744896.282348:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788744896.282353:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9ce2866099c0) has no exports 00000020:00000080:3.0:1788744896.282370:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287940000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788744896.282519:0:20760:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788744896.282527:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2941f 00000020:00000080:1.0:1788744896.282531:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce392b81800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788744896.282545:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788744896.282548:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744896.282553:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788744896.282556:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9ce287623380) has no exports 00000020:00000080:1.0:1788744896.282561:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29418 00000020:00000080:1.0:1788744896.282564:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce392b82800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744896.282584:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce392b81800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788744896.282591:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce392b82800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788744896.282907:0:20760:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788744896.282911:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788744896.282915:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788744896.282922:0:20760:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744896.284652:0:20760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744896.284710:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744896.284720:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744896.284728:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2940a 00000020:00000080:1.0:1788744896.284737:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce392b81000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788744896.284743:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788744896.284748:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744896.284752:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788744896.284766:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9ce287953380) has no exports 00000020:00000080:1.0:1788744896.284773:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29403 00000020:00000080:1.0:1788744896.284776:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce285a4a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744896.285164:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce392b82000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788744896.285172:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce392b83000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788744896.285174:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce392b83000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788744896.285180:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744896.285289:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce392b81000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788744896.285294:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce285a4a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788744896.285883:0:20760:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788744896.285888:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788744896.285892:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788744896.285898:0:20760:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744896.285899:0:20760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744896.286038:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744896.286046:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788744896.286177:0:20760:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788744896.286185:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc293f5 00000020:00000080:1.0:1788744896.286192:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3bd108800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788744896.295541:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788744896.295645:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744896.295659:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788744896.295665:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9ce28660b380) has no exports 00000020:00000080:1.0:1788744896.295675:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc293ee 00000020:00000080:1.0:1788744896.295684:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3bd10b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744896.297792:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce285a4f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788744896.297811:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce3bd10b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788744896.297815:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bd10b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788744896.297823:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744896.297915:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bd108800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788744896.297922:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bd10b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788744896.328136:0:20760:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788744896.328146:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788744896.328151:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788744896.328160:0:20760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744896.328227:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744896.328312:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3bd10e000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788744896.328412:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744896.328418:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3bd109000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744896.328422:0:20760:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bd109000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788744896.328433:0:20760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744896.328535:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744896.328540:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744896.328542:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce287ae9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744896.328545:0:20760:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287ae9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788744896.328549:0:20760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744896.328596:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc293c4 00000020:00000080:1.0:1788744896.328603:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce287946000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788744896.328648:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788744896.328652:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744896.328658:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788744896.328662:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9ce286608000) has no exports 00000020:00000080:1.0:1788744896.328679:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744896.328683:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788744896.328687:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc293cb 00000020:00000080:1.0:1788744896.328692:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce287941000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788744896.329068:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287946000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788744896.329169:0:8:0:(genops.c:885:class_export_put()) final put ffff9ce287944000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788744896.329171:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287944000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788744896.329179:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788744896.329458:0:20760:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce3bf8f6000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788744896.329462:0:20760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3bf8f6000 3 00000020:01000004:1.0:1788744896.329465:0:20760:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce3bf8f6000 from lustre-MDT0000 00000020:00000080:1.0:1788744896.329487:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744896.329491:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788744896.329494:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce287aea000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788744896.329497:0:20760:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287aea000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788744896.329504:0:20760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788744896.329537:0:20760:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788744896.329543:0:20760:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788744896.329546:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788744896.329549:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744896.329551:0:20760:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788744896.329565:0:20760:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9ce3a0109000 13868c1b-1e71-41ca-a26c-b8c8bf9c503a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788744896.329571:0:20760:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9ce287950000) has exports, disconnecting them 00000020:00080000:1.0:1788744896.329575:0:20760:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ce3a0109000), last request at 1788744802 00000020:00000080:1.0:1788744896.329593:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29370 00000020:00010000:1.0:1788744896.329597:0:20760:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ce3a0109000: total 1 00000100:00080000:1.0:1788744896.329601:0:20760:0:(import.c:65:import_set_state_nolock()) ffff9ce3a010e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788744896.329620:0:20760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce3a0109000): rc 0 00000020:00080000:1.0:1788744896.329624:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9ce287950000) has no exports 00000020:00010000:3.0:1788744896.330268:0:19391:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ce3a0109000: total 1 00010000:00010000:3.0:1788744896.330310:0:19391:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ce3a0109000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788744896.330348:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce28804f400/0x6e465a23bbc29935 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc2992e expref: 14 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330366:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3bd33fa00/0x6e465a23bbc294ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc294a4 expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330376:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3813f2600/0x6e465a23bbc29759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29752 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330385:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287b12c00/0x6e465a23bbc2937e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29377 expref: 11 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330395:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc29798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29791 expref: 10 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330409:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287920600/0x6e465a23bbc295fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc295f4 expref: 9 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330419:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287b13c00/0x6e465a23bbc29927 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29920 expref: 8 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330428:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287b12000/0x6e465a23bbc2954c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29545 expref: 7 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330438:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3bd33f600/0x6e465a23bbc2949d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29496 expref: 6 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330450:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287b12600/0x6e465a23bbc2972f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29728 expref: 5 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330459:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287b13a00/0x6e465a23bbc295d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc295ca expref: 4 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330480:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce287b12400/0x6e465a23bbc29919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29912 expref: 3 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330491:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3bd33ea00/0x6e465a23bbc2948f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6e465a23bbc29488 expref: 2 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744896.330500:0:19391:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ce3a0109000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788744896.330514:0:19391:0:(genops.c:885:class_export_put()) final put ffff9ce3a0109000/13868c1b-1e71-41ca-a26c-b8c8bf9c503a 00010000:00010000:3.0:1788744896.330521:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744896.330523:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744896.330525:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744896.330730:0:17184:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ce286774000:17184] 1 exiting: rc = 0 00000100:00100000:2.0:1788744896.331000:0:17183:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ce3c1a98c00:17183] 0 exiting: rc = 1 00000020:00000080:2.0:1788744896.331062:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287941000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788744896.331177:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3a0109000/13868c1b-1e71-41ca-a26c-b8c8bf9c503a for MGS 00000020:00000080:2.0:1788744896.331226:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3a010e000 for MGS 00000100:00100000:1.0:1788744896.331373:0:17185:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ce286775a00:17185] 2 exiting: rc = 0 00000100:00100000:2.0:1788744896.331510:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331519:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331525:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331531:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331537:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331543:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331549:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331555:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331561:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331568:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331575:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331582:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331588:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331594:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331599:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331604:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331610:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331616:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331621:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331626:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331631:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331637:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331643:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331649:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331654:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331659:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331665:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331672:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331678:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331685:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331690:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331696:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331701:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331708:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331722:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331728:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331733:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331739:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331744:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331750:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331818:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331826:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331831:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331836:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331842:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331848:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331853:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331858:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331863:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331868:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331873:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331878:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331884:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331889:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331894:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331899:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331904:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331910:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331915:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331920:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331927:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331932:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331938:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744896.331944:0:20760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788744896.333628:0:20760:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce3bd17da20 - data ffff9ce38f422000/ffff9ce3ac276000 00000020:01000000:2.0:1788744896.333745:0:20760:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce3812aa600 - data ffff9ce38f74f870/ffff9ce3bd22b400 00000020:00000080:2.0:1788744896.334504:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29354 00000020:00000080:2.0:1788744896.334515:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3bf8f1000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788744896.334581:0:20760:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce3bf8f6000 from MGS, refs=2 00000020:01000004:2.0:1788744896.334585:0:20760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3bf8f6000 2 00000020:01000004:2.0:1788744896.334588:0:20760:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce3bf8f6000 from MGS 00000020:00000080:2.0:1788744896.334609:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744896.334616:0:20760:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788744896.334619:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3bf8f3000/MGS 00000020:00000080:2.0:1788744896.334621:0:20760:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bf8f3000/MGS for MGS 00000020:01000000:2.0:1788744896.334629:0:20760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788744896.334692:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788744896.334697:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744896.334702:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788744896.334708:0:20760:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ce39242f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744896.334715:0:20760:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9ce287620000) has exports, disconnecting them 00000020:00080000:2.0:1788744896.334720:0:20760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ce39242f800), last request at 1788744802 00000020:00000080:2.0:1788744896.334724:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29457 00000020:00080000:2.0:1788744896.334734:0:20760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce39242f800): rc 0 00000020:00000080:2.0:1788744896.334739:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce39242f800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788744896.335228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bf8f1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788744896.336588:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce39242f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788744896.337338:0:20760:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788744896.337344:0:20760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744896.337349:0:20760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788744896.337356:0:20760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788744896.337582:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744896.337590:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788744896.337597:0:20760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3bf8f6000 1 00000020:00000080:3.0:1788744896.337603:0:20760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29346 00000020:00000080:3.0:1788744896.337610:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3bf8f2800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788744896.337615:0:20760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788744896.337620:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744896.337624:0:20760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788744896.337628:0:20760:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9ce287954d40) has no exports 00000020:00000080:1.0:1788744896.340497:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3bd10a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788744896.340513:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce392b85000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788744896.340516:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce392b85000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788744896.340524:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788744896.340605:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bf8f2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788744896.393179:0:20760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744896.393195:0:20760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788744896.393200:0:20760:0:(genops.c:885:class_export_put()) final put ffff9ce3bf8f2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744896.393205:0:20760:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bf8f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788744896.393968:0:20760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788744896.394307:0:20760:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce3bf8f4800 00000020:02000400:3.0:1788744896.394368:0:20760:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:1.0:1788744896.592570:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744896.592579:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788744896.592582:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ce394382000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744896.592591:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 619 00000100:00080000:1.0:1788744896.592598:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788744896.592609:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce394382000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788744896.592635:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3c1acd500 x1875634419892992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744896.592732:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875634419893376:0@lo:400:kworker.0 00000100:00100000:3.0:1788744896.592797:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744896.592839:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744896.592847:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3636:1875634419892864:0@lo:400:kworker.0 00000400:00000100:3.0:1788744896.592867:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634419892864 offset 0 length 224: 4 00000100:00100000:0.0:1788744896.592943:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419892992:0@lo:38:kworker.0 00000100:00100000:0.0:1788744896.592977:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744896.593036:0:20029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419893376 00000100:00100000:0.0:1788744896.593045:0:20029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419893376 00000100:00100000:0.0:1788744896.593103:0:20029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788744896.593111:0:20029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1875634419893376:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788744896.593119:0:20029:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788744896.593159:0:20029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1875634419893376:12345-0@lo:400:kworker.0 Request processed in 48us (362us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744896.593166:0:20029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788744896.593204:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788744896.593222:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9ce3bf889000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788744896.593226:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788744896.593765:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419892992 00000100:00100000:3.0:1788744896.593771:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419892992 00000100:00100000:3.0:1788744896.593798:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744896.593805:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1875634419892992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788744896.593825:0:17194:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744896.597541:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419893504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788744896.597642:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744896.597708:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419893504 00000100:00100000:2.0:1788744896.597717:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419893504 00000100:00100000:2.0:1788744896.597778:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788744896.597787:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419893504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788744896.597822:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788744896.597867:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419893504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744896.597874:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788744896.597898:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744896.597946:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419893504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788744896.600509:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419893120:0@lo:400:kworker.0 00000100:00100000:1.0:1788744896.600574:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744896.600639:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1875634419893632:0@lo:400:kworker.0 00000100:00100000:1.0:1788744896.600665:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744896.600690:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744896.600696:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419893248:0@lo:400:kworker.0 00000100:00100000:1.0:1788744896.600717:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744896.600733:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1875634419893760:0@lo:400:kworker.0 00000100:00100000:1.0:1788744896.600750:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744896.600782:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419893632 00000100:00100000:1.0:1788744896.600789:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419893632 00000100:00100000:1.0:1788744896.600823:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419893760 00000100:00100000:1.0:1788744896.600826:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419893760 00000100:00100000:1.0:1788744896.600860:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788744896.600870:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875634419893760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744896.600920:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875634419893760:12345-0@lo:400:kworker.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744896.600940:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788744896.600958:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788744896.600963:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875634419893632:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788744896.600968:0:17191:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788744896.600995:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875634419893632:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788744896.601000:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788744896.601035:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419893120 00000100:00100000:1.0:1788744896.601039:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419893120 00000100:00100000:1.0:1788744896.601072:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419893248 00000100:00100000:1.0:1788744896.601076:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419893248 00000100:00100000:1.0:1788744896.601094:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788744896.601100:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419893120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744896.601138:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419893120:12345-0@lo:400:kworker.0 Request processed in 39us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744896.601144:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788744896.601156:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788744896.601162:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419893248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744896.601188:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419893248:12345-0@lo:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744896.601193:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788744896.601237:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419893248:0@lo:400:kworker.0 00010000:00080000:1.0:1788744896.601285:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce2882f4e00 x1875634419893760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744896.601295:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1875634419893760:0@lo:400:kworker.0 00000100:00100000:1.0:1788744896.601305:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419893120:0@lo:400:kworker.0 00000100:00080000:1.0:1788744896.601313:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788744896.601317:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9ce285a14000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788744896.601321:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788744896.601325:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9ce285a14000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744896.601329:0:3634:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1788744896.601338:0:3634:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ce285a14000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788744896.601357:0:3634:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce2882f4700 x1875634419894144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744896.601380:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1875634419893632:0@lo:400:kworker.0 00000100:00080000:1.0:1788744896.601421:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744896.601426:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744896.601725:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419894016:0@lo:400:kworker.0 00000100:00100000:2.0:1788744896.601758:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744896.601778:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744896.601785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419893888:0@lo:400:kworker.0 00000100:00100000:2.0:1788744896.601804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744896.601843:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419894016 00000100:00100000:2.0:1788744896.601847:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419894016 00000100:00100000:2.0:1788744896.601875:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419893888 00000100:00100000:2.0:1788744896.601878:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419893888 00000100:00100000:2.0:1788744896.601908:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744896.601914:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875634419894016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744896.601950:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875634419894016:12345-0@lo:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744896.601956:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744896.601971:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788744896.601975:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875634419893888:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788744896.601979:0:17190:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788744896.602002:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875634419893888:12345-0@lo:400:kworker.0 Request processed in 26us (197us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788744896.602019:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788744896.602036:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788744896.602051:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788744896.602054:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ce383045000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788744896.602057:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788744896.602060:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ce383045000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744896.602072:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 575 00000100:00080000:2.0:1788744896.602085:0:3637:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ce383045000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744896.602101:0:3637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3c1905c00 x1875634419894272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744896.602113:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419893888:0@lo:400:kworker.0 00010000:00080000:2.0:1788744896.602125:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce2882f5180 x1875634419894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744896.602135:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419894016:0@lo:400:kworker.0 00000100:00080000:0.0:1788744896.607907:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9ce3bf889000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744896.607917:0:3636:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1788744896.608143:0:3636:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ce3bf889000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1788744896.608194:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1875634419894144:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788744896.611159:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744896.611215:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1875634419894272:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788744896.611272:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744896.611348:0:3636:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bcf7e300 x1875634419894400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744896.611376:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875634419893376:0@lo:400:kworker.0 00000100:00100000:0.0:1788744896.611399:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875634419894400:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788744896.611422:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744896.611690:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419894144 00000100:00100000:2.0:1788744896.611698:0:17189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419894144 00000100:00100000:2.0:1788744896.611736:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419894272 00000100:00100000:2.0:1788744896.611739:0:17189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419894272 00000100:00100000:2.0:1788744896.611756:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419894400 00000100:00100000:2.0:1788744896.611758:0:17189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419894400 00000100:00100000:2.0:1788744896.611772:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744896.611779:0:17189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419894144:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788744896.611800:0:17189:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744896.611844:0:17189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419894144:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 64us (690us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744896.611851:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744896.611868:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744896.611872:0:17189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419894272:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788744896.611881:0:17189:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744896.611906:0:17189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419894272:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 32us (633us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744896.611911:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744896.611949:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788744896.611954:0:17189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419894400:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788744896.611964:0:17189:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744896.611988:0:17189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419894400:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 33us (565us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744896.611994:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788744896.612048:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3bf889000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744896.612053:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744896.612057:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875634419894400:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1788744896.612066:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce285a14000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744896.612070:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744896.612073:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1875634419894144:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788744896.612081:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce383045000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744896.612084:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744896.612087:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1875634419894272:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788744896.644476:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1875634419892992:12345-0@lo:38:kworker.0 Request processed in 50661us (51488us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744896.644490:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788744896.644582:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce394382000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744896.644588:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744896.644593:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419892992:0@lo:38:kworker.0 00010000:00010000:1.0:1788744896.659294:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744897.688146:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744898.704854:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744899.158837:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419894528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744899.158935:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744899.159014:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419894528 00000100:00100000:0.0:1788744899.159023:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419894528 00000100:00100000:0.0:1788744899.159100:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788744899.159111:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419894528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744899.159146:0:18697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788744899.159189:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419894528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744899.159196:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788744899.159224:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744899.159280:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419894528:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788744899.729184:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744899.729429:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788744900.182726:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788744900.182738:0:19508:0:(genops.c:885:class_export_put()) final put ffff9ce3afafa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788744900.182806:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3afafa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788744900.182884:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3afafe000 for lustre-OST0001 00000020:01000004:0.0:1788744900.292963:0:20960:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788744900.316365:0:20960:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788744900.316423:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.316448:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.316456:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.316462:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.316482:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788744900.316487:0:20960:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788744900.316515:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744900.316520:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788744900.316526:0:20960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788744900.316533:0:20960:0:(import.c:65:import_set_state_nolock()) ffff9ce3bf889000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788744900.316538:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744900.316540:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788744900.316543:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788744900.317610:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.317624:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.317650:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.317657:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.317678:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744900.317684:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.317691:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.317697:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.317702:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.321405:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788744900.321463:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.321475:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.321482:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.321508:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321564:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788744900.321573:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321580:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921e00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:2.0:1788744900.321591:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321599:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744900.321607:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744900.321613:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744900.321616:0:17179:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788744900.321618:0:17179:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788744900.321668:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321675:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744900.321705:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321712:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287921e00/0x6e465a23bbc29545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2954c expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321727:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788744900.321730:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321735:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920000 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:2.0:1788744900.321738:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321745:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744900.321758:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744900.321764:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744900.321766:0:17179:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788744900.321780:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321787:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744900.321803:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321809:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287920000/0x6e465a23bbc294a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc294ab expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321818:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744900.321822:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321828:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f3600 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:2.0:1788744900.321831:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321849:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744900.321855:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744900.321859:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744900.321868:0:17179:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788744900.321869:0:17179:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788744900.321899:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321905:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744900.321912:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321918:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29798 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321932:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744900.321935:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321951:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804f000 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:2.0:1788744900.321954:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321961:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744900.321967:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744900.321972:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788744900.321974:0:17179:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788744900.321986:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.321991:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744900.322005:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744900.322013:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744900.322014:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744900.322016:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744900.322335:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419894656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744900.322407:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744900.322461:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744900.322467:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419895040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744900.322491:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744900.322520:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3637:1875634419894912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744900.322539:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744900.322556:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744900.322561:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3637:1875634419894784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744900.322585:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744900.322614:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419894656 00000100:00100000:2.0:1788744900.322621:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419894656 00000100:00100000:2.0:1788744900.322651:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419895040 00000100:00100000:2.0:1788744900.322654:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419895040 00000100:00100000:2.0:1788744900.322661:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419894912 00000100:00100000:2.0:1788744900.322664:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419894912 00000100:00100000:2.0:1788744900.322670:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419894784 00000100:00100000:2.0:1788744900.322672:0:17176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419894784 00000100:00100000:2.0:1788744900.322684:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744900.322691:0:17176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3635:x1875634419894656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788744900.322698:0:17176:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744900 with bad export cookie 7946137702062265200 00010000:00010000:1.0:1788744900.325352:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744900.325387:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744900.325396:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875634419895040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788744900.325404:0:17175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744900 with bad export cookie 7946137702062265200 00000100:00100000:1.0:1788744900.325506:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875634419895040:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (3016us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788744900.325513:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744900.325541:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744900.325546:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1875634419894912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788744900.325550:0:17175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744900 with bad export cookie 7946137702062265200 00000100:00100000:1.0:1788744900.325583:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1875634419894912:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (3043us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788744900.325589:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744900.325602:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744900.325607:0:17175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1875634419894784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788744900.325612:0:17175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744900 with bad export cookie 7946137702062265200 00000100:00100000:1.0:1788744900.325637:0:17175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1875634419894784:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (3051us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788744900.325643:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788744900.325695:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.146@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788744900.325700:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ce288807000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788744900.325704:0:3637:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788744900.326306:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744900.326465:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788744900.326476:0:20960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce28804f000/0x6e465a23bbc2992e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc29935 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744900.326492:0:20960:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788744900.326503:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.326511:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.326518:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.326536:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744900.326551:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788744900.326554:0:20960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788744900.326558:0:20960:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788744900.326596:0:20960:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788744900.326600:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788744900.326605:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744900.326612:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788744900.326617:0:20960:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9ce3afafd800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744900.326622:0:20960:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9ce285a10800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744900.326634:0:20960:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9ce38f820000) has exports, disconnecting them 00000020:00080000:0.0:1788744900.326639:0:20960:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ce3afafd800), last request at 1788744896 00000020:00000080:0.0:1788744900.326647:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29783 00000100:00080000:0.0:1788744900.326663:0:20960:0:(import.c:65:import_set_state_nolock()) ffff9ce3afafb800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788744900.326711:0:20960:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce3afafd800): rc 0 00000020:00000080:0.0:1788744900.326714:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3afafd800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788744900.326723:0:20960:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ce285a10800), last request at 1788744896 00000020:00000080:0.0:1788744900.326726:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29625 00000100:00080000:0.0:1788744900.326731:0:20960:0:(import.c:65:import_set_state_nolock()) ffff9ce285a11800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788744900.326737:0:20960:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce285a10800): rc 0 00000020:00000080:0.0:1788744900.326739:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce285a10800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788744900.326746:0:20960:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffab0841ca7ae0 00000100:00080000:0.0:1788744900.326765:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744900.326773:0:20960:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9ce3c1acd880 x1875634419892608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788744910 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744900.326783:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788744900.327973:0:20960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788744900.327981:0:20960:0:(import.c:65:import_set_state_nolock()) ffff9ce394382000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1788744900.328113:0:19391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744900.328122:0:19391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744900.328132:0:19391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921600 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:3.0:1788744900.328135:0:19391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744900.328144:0:19391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744900.328168:0:19391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744900.328174:0:19391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744900.328177:0:19391:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788744900.328179:0:19391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1788744900.328307:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.146@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1788744900.332844:0:17176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3635:x1875634419894656:12345-0@lo:103:ldlm_bl.0 Request processed in 10136us (10421us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788744900.332879:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00000080:2.0:1788744900.336783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3afafd800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788744900.336936:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce285a10800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788744900.336971:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3afafb800 for lustre-MDT0001 00000020:00000080:2.0:1788744900.336977:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce285a11800 for lustre-MDT0001 00010000:00010000:2.0:1788744900.336997:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744900.339168:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788744900.339177:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788744900.339193:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788744900.339285:0:20960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788744900.339317:0:20960:0:(import.c:65:import_set_state_nolock()) ffff9ce3af9b5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788744900.339342:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788744900.339344:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788744900.339352:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788744900.339416:0:20960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788744900.339424:0:20960:0:(import.c:65:import_set_state_nolock()) ffff9ce394689800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788744900.339476:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9ce38f820000) has no exports 00000100:00080000:1.0:1788744900.352890:0:3637:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.146@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788744900.352900:0:3637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788744900.352916:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3c1acca80 x1875634419892864/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788744912 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744900.352997:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3c1905c00 x1875634419894656/t0(0) o103->MGC192.168.201.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744916 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744900.353008:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bd4c2680 x1875634419895040/t0(0) o103->MGC192.168.201.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744916 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744900.353017:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bd4c0380 x1875634419894912/t0(0) o103->MGC192.168.201.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744916 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744900.353026:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce288290700 x1875634419894784/t0(0) o103->MGC192.168.201.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744916 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788744900.353034:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788744900.353037:0:3637:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788744900.353039:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744900.353865:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3636:1875634419892864:0@lo:400:kworker.0 00010000:00010000:3.0:1788744900.354043:0:19391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744900.354054:0:19391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744900.354074:0:19391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744900.354081:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287921600/0x6e465a23bbc29496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6e465a23bbc2949d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744900.354103:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744900.354105:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744900.354107:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744900.354117:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744900.354132:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:0:1875634419895424:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788744900.354505:0:3635:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ce288807000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788744900.354532:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419894656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744900.354550:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3635:1875634419895040:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788744900.354732:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9ce288807000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744900.354739:0:3637:0:(import.c:545:import_select_connection()) MGC192.168.201.146@tcp: connect to NID 0@lo last attempt 527 00000100:00080000:1.0:1788744900.354754:0:3637:0:(import.c:666:import_select_connection()) MGC192.168.201.146@tcp: import ffff9ce288807000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788744900.354770:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419895168:0@lo:9:umount.0 00000100:00100000:1.0:1788744900.354908:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744900.354994:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419895296:0@lo:9:umount.0 00000100:00100000:1.0:1788744900.355019:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744900.355308:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744900.355349:0:3637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce2882f7b80 x1875634419895552/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744900.355386:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3633:1875634419895552:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788744900.355411:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634419895552 offset 0 length 520: 4 00000100:00100000:1.0:1788744900.355448:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3637:1875634419894912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744900.355455:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419892608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744900.355468:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3637:1875634419894784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744900.355784:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419895168 00000100:00100000:0.0:1788744900.355793:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419895168 00000100:00100000:1.0:1788744900.355896:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419895296 00000100:00100000:1.0:1788744900.355900:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419895296 00000100:00100000:1.0:1788744900.355931:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744900.355950:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875634419895168:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744900.355976:0:18693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2964f 00000100:00080000:1.0:1788744900.355986:0:18693:0:(import.c:65:import_set_state_nolock()) ffff9ce285a16000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744900.356026:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788744900.356166:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3633:x1875634419895168:12345-0@lo:9:umount.0 Request processed in 226us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744900.356173:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744900.356189:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744900.356196:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875634419895296:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744900.356208:0:18693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc297b4 00000100:00080000:1.0:1788744900.356214:0:18693:0:(import.c:65:import_set_state_nolock()) ffff9ce3afaf9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744900.356235:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788744900.356332:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3633:x1875634419895296:12345-0@lo:9:umount.0 Request processed in 136us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744900.356338:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788744900.356356:0:17186:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788744900.356378:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744900.356405:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3af9b5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788744900.356420:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788744900.356422:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744900.356425:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419895168:0@lo:9:umount.0 00000100:00080000:1.0:1788744900.356436:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce394689800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788744900.356445:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788744900.356446:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744900.356449:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419895296:0@lo:9:umount.0 00010000:00010000:3.0:1788744900.356824:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788744900.366662:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9ce38f820000) has no exports 00000020:01000000:0.0:1788744900.465887:0:20960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce3bcf05420 - data ffff9ce38f486360/ffff9ce3a6229000 00000020:01000000:0.0:1788744900.466087:0:20960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce286bcab40 - data ffff9ce38f4c2870/ffff9ce3a62f2000 00000001:00000004:1.0:1788744900.487583:0:20960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788744900.564226:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744900.564297:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788744900.564305:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788744900.573604:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788744900.573611:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788744900.573632:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788744900.573635:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788744900.575555:0:17929:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788744900.575563:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1788744900.575577:0:17929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788744900.578207:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788744900.578216:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788744900.578238:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788744900.578241:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788744900.580116:0:17931:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788744900.580123:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788744900.580156:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788744900.581282:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc294b9 00000020:00000080:0.0:1788744900.581293:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce2813af800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788744900.582812:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc294ce 00000020:00000080:0.0:1788744900.582825:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3c1ae8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788744900.582831:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788744900.583994:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce2813af800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788744900.584033:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3c1ae8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788744900.584188:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744900.584198:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788744900.584203:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9ce38f823380) has no exports 00000004:01000000:0.0:1788744900.584409:0:20960:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788744900.584420:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29522 00000020:00000080:0.0:1788744900.584428:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3af9b1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788744900.584443:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788744900.584449:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744900.584454:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788744900.584456:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9ce38fe90000) has no exports 00000020:00000080:0.0:1788744900.584463:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2951b 00000020:00000080:0.0:1788744900.584467:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce39468e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788744900.585879:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3af9b1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788744900.585898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce39468e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788744900.588082:0:20960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788744900.588092:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788744900.588097:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788744900.588106:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788744900.588108:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744900.588209:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744900.588224:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788744900.588275:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2950d 00000020:00000080:0.0:1788744900.588286:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3bda7d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788744900.596130:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce394689800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788744900.596150:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce3bda7e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788744900.596154:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bda7e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788744900.596162:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788744900.596791:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788744900.596800:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744900.596812:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788744900.596817:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9ce38fe93380) has no exports 00000020:00000080:0.0:1788744900.596827:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc294ff 00000020:00000080:0.0:1788744900.596847:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3af9b5800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788744900.597328:0:20960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788744900.597333:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788744900.597337:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788744900.597343:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788744900.597345:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744900.597381:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744900.597387:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788744900.597408:0:20960:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788744900.597414:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc294f1 00000020:00000080:0.0:1788744900.597419:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3af9b0800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788744900.597423:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788744900.597427:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744900.597430:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788744900.597432:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9ce38f8219c0) has no exports 00000020:00000080:0.0:1788744900.597437:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc294ea 00000020:00000080:0.0:1788744900.597440:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce394383000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788744900.598404:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bda7d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788744900.598416:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3af9b5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788744900.598421:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3af9b5000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788744900.598426:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce3af9b2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788744900.598429:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3af9b2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788744900.598434:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744900.598493:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3af9b0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788744900.598498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce394383000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788744900.599523:0:20960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788744900.599529:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788744900.599534:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788744900.599540:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744900.599595:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744900.599605:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744900.599651:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744900.599656:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744900.599660:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce2813ae800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788744900.599664:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce2813ae800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788744900.599669:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744900.599820:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc294d5 00000020:00000080:1.0:1788744900.599826:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3bda7c000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788744900.599843:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788744900.599847:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744900.599851:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788744900.599855:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9ce38f824d40) has no exports 00000020:00000080:1.0:1788744900.599882:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744900.599886:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788744900.599891:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc294dc 00000020:00000080:1.0:1788744900.599894:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3bda7d000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788744900.599903:0:20960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce3bda7a000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788744900.599906:0:20960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3bda7a000 2 00000020:01000004:1.0:1788744900.599909:0:20960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce3bda7a000 from lustre-MDT0001 00000020:00000080:1.0:1788744900.599924:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744900.599928:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788744900.599930:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce2813a8000/lustre-MDT0001_UUID 00000020:00000080:1.0:1788744900.599932:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce2813a8000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788744900.599949:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788744900.599980:0:20960:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788744900.599983:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788744900.599986:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744900.599990:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788744900.599997:0:20960:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ce2813ac000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788744900.600003:0:20960:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9ce388af99c0) has exports, disconnecting them 00000020:00080000:1.0:1788744900.600010:0:20960:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ce2813ac000), last request at 1788744817 00000020:00000080:1.0:1788744900.600014:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2955a 00000020:00080000:1.0:1788744900.600027:0:20960:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce2813ac000): rc 0 00000020:00000080:1.0:1788744900.600031:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce2813ac000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788744900.603198:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce394382000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788744900.603223:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce394387000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788744900.603228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce394387000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788744900.603238:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744900.603433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bda7c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788744900.603439:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce2813a9000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788744900.603441:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce2813a9000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788744900.603444:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788744900.603563:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bda7d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788744900.603569:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce2813ac000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788744900.643657:0:20960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788744900.643681:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744900.643687:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788744900.643695:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788744900.643726:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3bf889000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788744900.643918:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744900.643927:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788744900.643933:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce2813ad800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788744900.643949:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce2813ad800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788744900.643959:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788744900.644025:0:20960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3bda7a000 1 00000020:00000080:3.0:1788744900.644030:0:20960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29481 00000020:00000080:3.0:1788744900.644036:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce287731800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788744900.644044:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788744900.644051:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287731800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788744900.644059:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744900.644063:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744900.644067:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9ce2879519c0) has no exports 00000020:00000080:3.0:1788744900.704993:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744900.705008:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788744900.705014:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce3bda7e800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788744900.705018:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bda7e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788744900.705029:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788744900.705198:0:20960:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce3bda7f000 00000020:01000000:3.0:1788744900.705219:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788744900.705225:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744900.705230:0:20960:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744900.705234:0:20960:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9ce2876219c0) has no exports 00000100:00100000:2.0:1788744900.705435:0:17191:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9ce286b27e00:17191] 2 exiting: rc = 0 00000100:00100000:0.0:1788744900.705563:0:17189:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9ce286b27600:17189] 0 exiting: rc = 1 00000100:00100000:2.0:1788744900.705586:0:20029:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9ce286794600:20029] 3 exiting: rc = 0 00000100:00100000:0.0:1788744900.705671:0:20327:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9ce28769b600:20327] 4 exiting: rc = 0 00000100:00100000:2.0:1788744900.705772:0:17190:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9ce3c1b04600:17190] 1 exiting: rc = 0 00000100:00100000:3.0:1788744900.706170:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706179:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706187:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706193:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706212:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706219:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706226:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706232:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706236:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706242:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706287:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706294:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706301:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706309:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706315:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706323:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706329:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706335:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706341:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706347:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706353:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706359:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706365:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706370:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706376:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706381:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706387:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706393:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706399:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706406:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706412:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706417:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706423:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706429:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706435:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706442:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706450:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706457:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706466:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706482:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706490:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706495:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706501:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706507:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706513:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706519:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706524:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706530:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706537:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706543:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706549:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706554:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706560:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706566:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706572:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706577:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706583:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706589:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706594:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706599:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706773:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706783:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706868:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.706874:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744900.712610:0:17192:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ce39025aa00:17192] 0 exiting: rc = 1 00000100:00100000:2.0:1788744900.712707:0:17193:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ce3a0c7f600:17193] 1 exiting: rc = 0 00000100:00100000:3.0:1788744900.713391:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713400:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713406:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713411:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713417:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713422:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713426:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713431:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713436:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713441:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713460:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713466:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713472:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713478:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713483:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713488:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713494:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713499:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713505:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713509:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713515:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713520:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713524:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713528:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713533:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713538:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713543:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713548:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713553:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713558:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713563:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713567:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713572:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713577:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713581:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713585:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713590:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713595:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713600:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713604:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713622:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713627:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713633:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713638:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713643:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713656:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713661:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713665:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713670:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713676:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713680:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713685:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713690:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713694:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713699:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713704:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713709:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713713:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713717:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713722:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713726:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713731:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713736:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.713741:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.718744:0:17195:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9ce3a6d6c800:17195] 1 exiting: rc = 0 00000100:00100000:0.0:1788744900.718761:0:20328:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9ce2869ada00:20328] 2 exiting: rc = 0 00000100:00100000:2.0:1788744900.720043:0:17194:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9ce3a0c7fa00:17194] 0 exiting: rc = 1 00000100:00100000:3.0:1788744900.720536:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720544:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720552:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720558:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720565:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720571:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720578:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720584:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720591:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720599:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720632:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720640:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720647:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720658:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720664:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720683:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720690:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720696:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720702:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720711:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720717:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720727:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720752:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720759:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720766:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720772:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720779:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720863:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720871:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720878:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720885:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720891:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720899:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720905:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720928:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720947:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720954:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720960:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720969:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720976:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720984:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720991:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.720997:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721004:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721010:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721016:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721037:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721113:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721123:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721130:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721143:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721150:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721157:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721163:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721238:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721271:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721278:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721284:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721307:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721314:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721320:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721326:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721333:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.721339:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744900.734986:0:17196:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ce38fd04e00:17196] 0 exiting: rc = 1 00000100:00100000:1.0:1788744900.735150:0:17197:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ce38fd04200:17197] 1 exiting: rc = 0 00000100:00100000:3.0:1788744900.735284:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735292:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735298:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735302:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735308:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735313:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735318:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735323:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735328:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735333:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735337:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735343:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735349:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735354:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735359:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735364:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735369:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735374:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735379:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735385:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735390:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735407:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735411:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735416:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735421:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735425:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735430:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735434:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735439:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735443:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735448:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735452:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735457:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735461:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735467:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735473:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735478:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735483:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735487:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735492:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735497:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735502:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735507:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735512:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735517:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735522:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735527:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735532:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735537:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735543:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735548:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735552:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735561:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735565:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735570:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735574:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735589:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735593:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735597:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735602:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735607:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735611:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735615:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.735619:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744900.736495:0:17199:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ce3a1b31e00:17199] 1 exiting: rc = 0 00000100:00100000:2.0:1788744900.736632:0:17198:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ce3c1a99400:17198] 0 exiting: rc = 1 00000100:00100000:3.0:1788744900.737004:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737011:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737016:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737022:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737027:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737032:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737036:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737042:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737111:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737117:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737121:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737126:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737131:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737135:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737140:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737145:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737149:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737154:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737159:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737164:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737409:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737415:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737421:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737426:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737430:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737435:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737440:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737457:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737462:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737467:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737473:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737478:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737483:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737489:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737495:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737501:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737506:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737510:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737516:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737520:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737525:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737530:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737535:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737541:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737546:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737550:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737555:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737559:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737564:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737568:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737573:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737578:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737583:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737588:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737593:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737598:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737602:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737607:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737612:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737617:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737623:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737628:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737641:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.737647:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744900.738099:0:17200:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ce391d6b200:17200] 0 exiting: rc = 1 00000100:00100000:1.0:1788744900.738380:0:17201:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ce391d6b600:17201] 1 exiting: rc = 0 00000100:00100000:3.0:1788744900.738485:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738492:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738497:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738503:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738508:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738513:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738519:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738524:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738530:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738536:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738542:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738547:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738552:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738559:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738564:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738570:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738575:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738580:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738585:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738590:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738595:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738601:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738606:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738612:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738617:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738623:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738628:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738633:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738638:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738643:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738648:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738653:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738658:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738673:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738678:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738682:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738687:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738692:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738697:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738702:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738707:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738712:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738717:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738722:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738727:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738731:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738736:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738741:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738746:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738750:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738756:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738761:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738766:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738771:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738776:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738782:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738798:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738803:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738808:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738813:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738818:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738824:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738829:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.738835:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.739508:0:17203:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9ce391f75e00:17203] 1 exiting: rc = 0 00000100:00100000:1.0:1788744900.739720:0:17202:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9ce391f74a00:17202] 0 exiting: rc = 1 00000100:00100000:2.0:1788744900.740887:0:17204:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9ce38fde0e00:17204] 2 exiting: rc = 0 00000100:00100000:3.0:1788744900.742069:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742079:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742086:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742114:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742120:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742126:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742134:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742140:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742146:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742151:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742157:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742163:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742495:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742506:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742512:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742518:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742524:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742529:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742535:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742541:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742547:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742554:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742561:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742568:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742574:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742581:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742588:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742595:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742602:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742608:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742615:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742623:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742630:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742638:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742644:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742652:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742676:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742684:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742697:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742704:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742709:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742716:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742721:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742728:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742735:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742741:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742747:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742753:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742759:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742764:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742770:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742776:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742782:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742802:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742809:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742815:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742820:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742826:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742831:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742837:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742843:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742849:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742854:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744900.742861:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788744900.748013:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744900.748030:0:20960:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788744900.748036:0:20960:0:(genops.c:885:class_export_put()) final put ffff9ce396719800/MDS_uuid 00000020:00000080:3.0:1788744900.748041:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce396719800/MDS_uuid for MDS 00000020:01000000:3.0:1788744900.748237:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788744900.748513:0:20960:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788744900.773418:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744901.719008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744901.719044:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744901.719049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744901.719054:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788744901.719059:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce285a14000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744901.719071:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 621 00000100:00080000:2.0:1788744901.719080:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744901.719099:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ce285a14000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744901.719175:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c3800 x1875634419895680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744901.719334:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1875634419895680:0@lo:38:kworker.0 00000400:00000100:3.0:1788744901.719407:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419895680 offset 0 length 520: 4 00000100:00080000:2.0:1788744901.719438:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744901.719442:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788744901.719445:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce383045000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744901.719449:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 621 00000100:00080000:2.0:1788744901.719452:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744901.719458:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ce383045000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744901.719473:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c1180 x1875634419895936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744901.719520:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419895808:0@lo:400:kworker.0 00000400:00000100:2.0:1788744901.719546:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419895808 offset 0 length 224: 4 00000100:00100000:2.0:1788744901.719563:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744901.719569:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1875634419895936:0@lo:38:kworker.0 00000100:00100000:2.0:1788744901.719569:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1875634419896064:0@lo:400:kworker.0 00000400:00000100:2.0:1788744901.719586:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419896064 offset 0 length 224: 4 00000400:00000100:3.0:1788744901.719587:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419895936 offset 0 length 520: 4 00010000:00010000:2.0:1788744901.776673:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744902.812634:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744903.824418:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744904.850778:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744904.866798:0:21162:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788744904.885385:0:21162:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788744904.885445:0:21162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744904.885461:0:21162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744904.885468:0:21162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744904.885489:0:21162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744904.885510:0:21162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788744904.885516:0:21162:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788744904.885544:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744904.885557:0:21162:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bd4c3800 x1875634419895680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744916 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744904.885574:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788744904.885606:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce285a14000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744904.885611:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1788744904.885615:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1875634419895680:0@lo:38:kworker.0 00000100:00080000:3.0:1788744904.885643:0:21162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788744904.885648:0:21162:0:(import.c:65:import_set_state_nolock()) ffff9ce285a14000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788744904.885652:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744904.885668:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788744904.885672:0:21162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788744904.886517:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788744904.886526:0:21162:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bd4c3100 x1875634419895808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744917 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744904.886544:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788744904.886572:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419895808:0@lo:400:kworker.0 00000100:00080000:3.0:1788744904.886596:0:21162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788744904.886621:0:21162:0:(import.c:65:import_set_state_nolock()) ffff9ce396681800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788744904.886645:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1875634419896192:0@lo:39:umount.0 00000400:00000100:3.0:1788744904.886695:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419896192 offset 0 length 224: 4 00010000:00010000:2.0:1788744904.892172:0:19391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744904.892188:0:19391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744904.892202:0:19391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804fe00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:2.0:1788744904.892207:0:19391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744904.892218:0:19391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744904.892225:0:19391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744904.892232:0:19391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744904.892235:0:19391:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788744904.892238:0:19391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788744904.892275:0:19391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce288807000 00010000:00010000:2.0:1788744904.892280:0:19391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744904.892287:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce28804fe00/0x6e465a23bbc295f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc295fb expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744904.892303:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744904.892306:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744904.892308:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744905.744431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788744905.744444:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744905.744447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788744905.744450:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788744905.744716:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744905.744739:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1875634419896320:0@lo:400:kworker.0 00000400:00000100:0.0:1788744905.744797:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419896320 offset 0 length 224: 4 00000001:00100000:1.0:1788744905.816702:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788744905.816713:0:19508:0:(genops.c:885:class_export_put()) final put ffff9ce3afaf8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788744905.816836:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3afaf8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788744905.816903:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3afaf9800 for lustre-OST0001 00000001:00100000:0.0:1788744905.819702:0:18689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788744905.819713:0:18689:0:(genops.c:885:class_export_put()) final put ffff9ce285a15800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788744905.819796:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce285a15800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788744905.819865:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce285a16000 for lustre-OST0000 00010000:00010000:0.0:1788744905.873374:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744906.768462:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744906.768487:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744906.768490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744906.768492:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788744906.768685:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1875634419896448:0@lo:400:kworker.0 00000400:00000100:0.0:1788744906.768739:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419896448 offset 0 length 224: 4 00010000:00010000:2.0:1788744906.896794:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744907.927507:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744908.946155:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744909.968877:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744910.034107:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744900/real 1788744900] req@ffff9ce2882f7b80 x1875634419895552/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788744910 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744910.034143:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce2882f7b80 x1875634419895552/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788744910 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744910.034166:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce288807000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744910.034194:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788744910.034199:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3633:1875634419895552:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788744910.034311:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744910.034317:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788744910.034320:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce288807000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744910.034324:0:8:0:(import.c:545:import_select_connection()) MGC192.168.201.146@tcp: connect to NID 0@lo last attempt 625 00000100:00080000:2.0:1788744910.034330:0:8:0:(import.c:630:import_select_connection()) MGC192.168.201.146@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744910.034342:0:8:0:(import.c:666:import_select_connection()) MGC192.168.201.146@tcp: import ffff9ce288807000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744910.034376:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c1880 x1875634419896576/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744910.034408:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788744910.034412:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744910.034518:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744910.034534:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419896704:0@lo:400:kworker.0 00000400:00000100:1.0:1788744910.034584:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419896704 offset 0 length 224: 4 00000100:00100000:3.0:1788744910.034865:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3633:1875634419896576:0@lo:250:kworker.0 00000400:00000100:3.0:1788744910.034902:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634419896576 offset 0 length 520: 4 00010000:00010000:2.0:1788744910.999323:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744912.016612:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744913.040909:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744914.064610:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744914.129560:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744904/real 1788744904] req@ffff9ce3a6bb1c00 x1875634419896192/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788744914 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744914.129596:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3a6bb1c00 x1875634419896192/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788744914 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744914.129616:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce396681800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788744914.129651:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1875634419896192:0@lo:39:umount.0 00000100:00080000:0.0:1788744914.129946:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788744914.129951:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788744914.129957:0:21162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788744914.131121:0:21162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744914.131139:0:21162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744914.131146:0:21162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744914.131152:0:21162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744914.131272:0:21162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744914.131282:0:21162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744914.131306:0:21162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744914.131311:0:21162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744914.131317:0:21162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744914.131988:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744914.131997:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744914.132005:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33f200 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744914.132009:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744914.132018:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744914.132026:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744914.132032:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744914.132034:0:17178:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788744914.132046:0:17178:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce288807000 00010000:00010000:1.0:1788744914.132049:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744914.132054:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f200/0x6e465a23bbc295ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc295d1 expref: -99 pid: 18688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744914.132084:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744914.132089:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744914.132094:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287b13e00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744914.132097:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744914.132104:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744914.132110:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744914.132116:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788744914.132118:0:17178:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788744914.132123:0:17178:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce288807000 00010000:00010000:1.0:1788744914.132126:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744914.132133:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744914.132135:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744914.132137:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744914.136737:0:21162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788744914.136752:0:21162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287b13e00/0x6e465a23bbc29920 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc29927 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744914.136774:0:21162:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788744914.136786:0:21162:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788744914.136791:0:21162:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788744914.136830:0:21162:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788744914.136835:0:21162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788744914.136845:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744914.136851:0:21162:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788744914.136856:0:21162:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9ce3bd040000) has no exports 00000020:00080000:0.0:1788744914.136883:0:21162:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9ce3bd040000) has no exports 00000020:01000000:0.0:1788744914.142717:0:21162:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce3a6b9ed20 - data ffff9ce285c04438/ffff9ce3a6bc6c00 00000020:01000000:0.0:1788744914.142889:0:21162:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce28774e0c0 - data ffff9ce38f7396c0/ffff9ce3b401b000 00010000:00010000:2.0:1788744914.144692:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788744914.154852:0:21162:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788744914.175387:0:21162:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc295df 00000020:00000080:3.0:1788744914.175402:0:21162:0:(genops.c:885:class_export_put()) final put ffff9ce383044000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788744914.175421:0:21162:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce285a6b800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788744914.175425:0:21162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce285a6b800 2 00000020:01000004:3.0:1788744914.175437:0:21162:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce285a6b800 from lustre-OST0000 00000020:00000080:3.0:1788744914.175462:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744914.175471:0:21162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788744914.175474:0:21162:0:(genops.c:885:class_export_put()) final put ffff9ce396686800/lustre-OST0000_UUID 00000020:00000080:3.0:1788744914.175477:0:21162:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce396686800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788744914.175484:0:21162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788744914.175530:0:21162:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788744914.175534:0:21162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788744914.175537:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744914.175541:0:21162:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788744914.175548:0:21162:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ce285a17800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788744914.175554:0:21162:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9ce3c18eb380) has exports, disconnecting them 00000020:00080000:3.0:1788744914.175559:0:21162:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ce285a17800), last request at 1788744833 00000020:00000080:3.0:1788744914.175562:0:21162:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29609 00000020:00080000:3.0:1788744914.175571:0:21162:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce285a17800): rc 0 00000020:00000080:3.0:1788744914.175576:0:21162:0:(genops.c:885:class_export_put()) final put ffff9ce285a17800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788744914.176290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce383044000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788744914.176304:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce285a17800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788744914.177320:0:21162:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788744914.177340:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744914.177344:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788744914.177352:0:21162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744914.177379:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce285a14000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788744914.177572:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744914.177580:0:21162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788744914.177585:0:21162:0:(genops.c:885:class_export_put()) final put ffff9ce39468d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788744914.177589:0:21162:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce39468d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788744914.177597:0:21162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788744914.177663:0:21162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788744914.177667:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744914.177671:0:21162:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788744914.177677:0:21162:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9ce396683800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744914.177682:0:21162:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9ce3bd043380) has exports, disconnecting them 00000020:00080000:0.0:1788744914.177686:0:21162:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9ce396683800), last request at 1788744833 00000020:00000080:0.0:1788744914.177690:0:21162:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2961e 00000020:00080000:0.0:1788744914.177715:0:21162:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce396683800): rc 0 00000020:00000080:0.0:1788744914.177718:0:21162:0:(genops.c:885:class_export_put()) final put ffff9ce396683800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788744914.177745:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce396683800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788744914.180623:0:21162:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788744914.180633:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788744914.180638:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788744914.180647:0:21162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788744914.180859:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744914.180869:0:21162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788744914.180877:0:21162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce285a6b800 1 00000020:00000080:2.0:1788744914.180884:0:21162:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc295bc 00000020:00000080:2.0:1788744914.180892:0:21162:0:(genops.c:885:class_export_put()) final put ffff9ce285a6e000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788744914.180898:0:21162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788744914.181098:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744914.181106:0:21162:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788744914.181112:0:21162:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9ce3c18ecd40) has no exports 00000020:00000080:2.0:1788744914.189189:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce396681800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788744914.190883:0:8:0:(genops.c:885:class_export_put()) final put ffff9ce396682000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788744914.190888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce396682000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788744914.190902:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788744914.190997:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce285a6e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788744914.408168:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744914.408184:0:21162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788744914.408192:0:21162:0:(genops.c:885:class_export_put()) final put ffff9ce285a6c800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788744914.408197:0:21162:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce285a6c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788744914.408211:0:21162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788744914.408415:0:21162:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce285a6a000 00000020:02000400:2.0:1788744914.408467:0:21162:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788744915.094348:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744915.540811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788744915.540824:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744915.540826:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788744915.540829:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744915.540995:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419896832:0@lo:400:kworker.0 00000400:00000100:2.0:1788744915.541053:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419896832 offset 0 length 224: 4 00010000:00010000:1.0:1788744916.112793:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744916.176818:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744901/real 1788744901] req@ffff9ce3bd4c1180 x1875634419895936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788744916 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744916.176853:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3bd4c1180 x1875634419895936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788744916 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744916.176873:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce383045000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744916.176897:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744916.176902:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1875634419895936:0@lo:38:kworker.0 00000100:00080000:0.0:1788744916.176971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744916.176977:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744916.176979:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744916.176983:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788744916.176986:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce383045000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744916.176991:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 626 00000100:00080000:0.0:1788744916.176996:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788744916.177007:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ce383045000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1788744916.177060:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bcf7c380 x1875634419896960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744916.177131:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419897088:0@lo:400:kworker.0 00000400:00000100:0.0:1788744916.177179:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419897088 offset 0 length 224: 4 00000100:00100000:3.0:1788744916.178285:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1875634419896960:0@lo:38:kworker.0 00000400:00000100:3.0:1788744916.178325:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419896960 offset 0 length 520: 4 00010000:00010000:2.0:1788744917.137576:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788744917.904598:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744901/real 1788744901] req@ffff9ce3bd4c0e00 x1875634419896064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788744917 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744917.922385:0:3636:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ce3bd4c0e00 x1875634419896064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788744917 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744917.922401:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9ce3afafd000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788744917.922404:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788744917.945141:0:3636:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788744917.945200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788744917.945216:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1875634419896064:0@lo:400:kworker.0 00000100:00080000:1.0:1788744917.945216:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744917.945219:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744917.945222:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744917.945229:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744917.945232:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788744917.945236:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce3afafd000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744917.956939:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 575 00000100:00080000:1.0:1788744917.956970:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ce3afafd000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788744917.957042:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce2882f6d80 x1875634419897216/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744917.957524:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1875634419897216:0@lo:38:kworker.0 00000400:00000100:2.0:1788744917.957582:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634419897216 offset 0 length 520: 4 00010000:00010000:2.0:1788744918.160488:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788744918.363240:0:21364:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788744918.389624:0:21364:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788744918.389750:0:21364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.389776:0:21364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.389788:0:21364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.389799:0:21364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.389937:0:21364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788744918.389944:0:21364:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788744918.389991:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788744918.390010:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bcf7c380 x1875634419896960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744936 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.390038:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788744918.390047:0:21364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788744918.390078:0:21364:0:(import.c:65:import_set_state_nolock()) ffff9ce383045000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788744918.390087:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788744918.390095:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bcf7c380 x1875634419896960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744936 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.390106:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788744918.390114:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1788744918.390333:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1875634419896960:0@lo:38:kworker.0 00000100:00080000:1.0:1788744918.392062:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788744918.392078:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3a6bb3800 x1875634419896320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744921 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.392107:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce2882f6680 x1875634419896448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744922 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.392117:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bd4c1500 x1875634419896704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744926 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.392372:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3a6bb1c00 x1875634419896832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744931 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.392389:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bcf7ed80 x1875634419897088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744932 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.392419:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce2882f6d80 x1875634419897216/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744927 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.392439:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788744918.392451:0:21364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788744918.392460:0:21364:0:(import.c:65:import_set_state_nolock()) ffff9ce3afafd000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788744918.392472:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788744918.392485:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3a6bb3800 x1875634419896320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744921 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.392493:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce2882f6680 x1875634419896448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744922 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.392527:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bd4c1500 x1875634419896704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744926 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744918.392622:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1875634419896448:0@lo:400:kworker.0 00000100:00100000:3.0:1788744918.393377:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419896704:0@lo:400:kworker.0 00010000:00010000:0.0:1788744918.394780:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744918.394796:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744918.394809:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804fc00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:0.0:1788744918.394814:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744918.394825:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744918.394833:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744918.394839:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788744918.394842:0:17178:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788744918.394846:0:17178:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788744918.394867:0:17178:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce288807000 00010000:00010000:0.0:1788744918.394872:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744918.394878:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce28804fc00/0x6e465a23bbc29752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc29759 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744918.394894:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744918.394916:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744918.394919:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744918.394959:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419897088:0@lo:400:kworker.0 00000100:00100000:1.0:1788744918.395007:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3a6bb1c00 x1875634419896832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744931 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.395019:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bcf7ed80 x1875634419897088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744932 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.395029:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce2882f6d80 x1875634419897216/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744927 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744918.395038:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788744918.396170:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1875634419896320:0@lo:400:kworker.0 00000100:00100000:2.0:1788744918.396269:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1875634419897216:0@lo:38:kworker.0 00000100:00100000:3.0:1788744918.396450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419896832:0@lo:400:kworker.0 00000100:00100000:1.0:1788744918.397071:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788744918.399064:0:21364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.399083:0:21364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.399090:0:21364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.399097:0:21364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.399115:0:21364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744918.399122:0:21364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.399129:0:21364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.399156:0:21364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.399162:0:21364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744918.399359:0:21364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788744918.399365:0:21364:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788744918.399393:0:21364:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788744918.399397:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788744918.399403:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744918.399409:0:21364:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788744918.399413:0:21364:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9ce2818e0000) has no exports 00000020:00080000:1.0:1788744918.399436:0:21364:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9ce2818e0000) has no exports 00000020:01000000:1.0:1788744918.402240:0:21364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce382d4a780 - data ffff9ce285c06d80/ffff9ce3b404a000 00010000:00010000:3.0:1788744918.402398:0:19391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744918.402415:0:19391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744918.402430:0:19391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33ec00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:3.0:1788744918.402435:0:19391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744918.402446:0:19391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744918.402486:0:19391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744918.402493:0:19391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744918.402497:0:19391:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788744918.402501:0:19391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788744918.402525:0:19391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce288807000 00010000:00010000:3.0:1788744918.402529:0:19391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744918.402536:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ec00/0x6e465a23bbc29728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc2972f expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744918.402553:0:19391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744918.402557:0:19391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744918.402564:0:19391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920200 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:3.0:1788744918.402567:0:19391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744918.402575:0:19391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744918.402582:0:19391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744918.402588:0:19391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788744918.402590:0:19391:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788744918.402597:0:19391:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788744918.402604:0:19391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce288807000 00010000:00010000:3.0:1788744918.402608:0:19391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744918.402615:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287920200/0x6e465a23bbc29912 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc29919 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744918.402641:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744918.402642:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744918.402644:0:19391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744918.402849:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788744918.403404:0:21364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ce382d4a4e0 - data ffff9ce38f678438/ffff9ce281825c00 00100000:10000000:1.0:1788744918.412671:0:21364:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788744918.418823:0:21364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2973d 00000020:00000080:2.0:1788744918.418837:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce39026c000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788744918.418859:0:21364:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce285a13800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788744918.418863:0:21364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce285a13800 2 00000020:01000004:2.0:1788744918.418866:0:21364:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ce285a13800 from lustre-OST0001 00000020:00000080:2.0:1788744918.418890:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744918.418898:0:21364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788744918.418901:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce287b4c000/lustre-OST0001_UUID 00000020:00000080:2.0:1788744918.418904:0:21364:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287b4c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788744918.418912:0:21364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788744918.419012:0:21364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 13868c1b-1e71-41ca-a26c-b8c8bf9c503a->MGS 00010000:00010000:2.0:1788744918.419027:0:21364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29488 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc2948f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744918.419039:0:21364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29488 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc2948f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744918.419046:0:21364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788744918.419048:0:21364:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788744918.419060:0:21364:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788744918.419075:0:21364:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce288807000 00010000:00010000:2.0:1788744918.419080:0:21364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29488 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc2948f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744918.419096:0:21364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6e465a23bbc2937e expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744918.419104:0:21364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6e465a23bbc2937e expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744918.419109:0:21364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744918.419112:0:21364:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788744918.419113:0:21364:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788744918.419123:0:21364:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ce288807000 00010000:00010000:2.0:1788744918.419126:0:21364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6e465a23bbc2937e expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744918.419142:0:21364:0:(import.c:65:import_set_state_nolock()) ffff9ce288807000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788744918.419147:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788744918.419150:0:21364:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788744918.419151:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788744918.419155:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788744918.419166:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ce3bd4c1880 x1875634419896576/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788744925 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788744918.419190:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744918.419193:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788744918.419384:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13868c1b-1e71-41ca-a26c-b8c8bf9c503a:3633:1875634419896576:0@lo:250:kworker.0 00000020:00000080:1.0:1788744918.419460:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce39026c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1788744918.419577:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788744918.419585:0:21364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29362 00000020:00000080:2.0:1788744918.419590:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce39671a000/13868c1b-1e71-41ca-a26c-b8c8bf9c503a 00000020:01000000:2.0:1788744918.419605:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.146@tcp (flags='') 00000020:00000080:2.0:1788744918.419609:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744918.419620:0:21364:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.146@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788744918.419635:0:21364:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9ce3c18e8000) has no exports 10000000:01000000:0.0:1788744918.419694:0:17187:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788744918.419773:0:21364:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.146@tcp: client import never connected 00000100:00080000:2.0:1788744918.419776:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788744918.419778:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744918.419780:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788744918.419782:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788744918.419817:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744918.419822:0:21364:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.146@tcp (uuid 13868c1b-1e71-41ca-a26c-b8c8bf9c503a) 00000020:01000000:2.0:1788744918.419827:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788744918.419830:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744918.419834:0:21364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788744918.419838:0:21364:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ce3a3069000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744918.419844:0:21364:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9ce3bd044d40) has exports, disconnecting them 00000020:00080000:2.0:1788744918.419848:0:21364:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ce3a3069000), last request at 1788744850 00000020:00000080:2.0:1788744918.419852:0:21364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29767 00000020:00080000:2.0:1788744918.419863:0:21364:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce3a3069000): rc 0 00000020:00000080:2.0:1788744918.419867:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce3a3069000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788744918.420844:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce39671a000/13868c1b-1e71-41ca-a26c-b8c8bf9c503a for MGC192.168.201.146@tcp 00000020:00000080:1.0:1788744918.420859:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce288807000 for MGC192.168.201.146@tcp 00000020:00000080:1.0:1788744918.420867:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce288801800/13868c1b-1e71-41ca-a26c-b8c8bf9c503a 00000020:00000080:1.0:1788744918.420869:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce288801800/13868c1b-1e71-41ca-a26c-b8c8bf9c503a for MGC192.168.201.146@tcp 00000020:01000000:1.0:1788744918.420874:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.146@tcp (13868c1b-1e71-41ca-a26c-b8c8bf9c503a) 00000020:00000080:1.0:1788744918.421125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3a3069000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788744918.424325:0:21364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788744918.424337:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744918.424342:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788744918.424353:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744918.424577:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744918.424588:0:21364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788744918.424597:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788744918.424602:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744918.424606:0:21364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788744918.424613:0:21364:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9ce3afafa800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744918.424620:0:21364:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9ce38fe94d40) has exports, disconnecting them 00000020:00080000:0.0:1788744918.424635:0:21364:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9ce3afafa800), last request at 1788744850 00000020:00000080:0.0:1788744918.424639:0:21364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc2977c 00000020:00080000:0.0:1788744918.424655:0:21364:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ce3afafa800): rc 0 00000020:00000080:0.0:1788744918.424660:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce3afafa800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788744918.425425:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce383045000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788744918.425435:0:36:0:(genops.c:885:class_export_put()) final put ffff9ce286b6e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788744918.425438:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce286b6e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788744918.425460:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788744918.425529:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3afafa800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788744918.444972:0:21364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788744918.444980:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788744918.444985:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788744918.444993:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744918.445106:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ce3afafd000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788744918.445190:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788744918.445468:0:19391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788744918.445660:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788744918.445824:0:17173:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ce3c1b05a00:17173] 0 exiting: rc = 1 00000100:00100000:2.0:1788744918.445948:0:17174:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ce286804800:17174] 1 exiting: rc = 0 00000100:00100000:0.0:1788744918.446035:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.446764:0:18718:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ce28679ca00:18718] 3 exiting: rc = 0 00000100:00100000:2.0:1788744918.446919:0:17177:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ce286ad6e00:17177] 2 exiting: rc = 0 00000100:00100000:2.0:1788744918.446986:0:17176:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ce286ad7c00:17176] 1 exiting: rc = 0 00000100:00100000:2.0:1788744918.447046:0:17175:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ce3c1932600:17175] 0 exiting: rc = 1 00000100:00100000:0.0:1788744918.447118:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447126:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447133:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447140:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447158:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447163:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447168:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447173:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447178:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447183:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447189:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447194:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447199:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447217:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447222:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447228:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447233:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447238:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447403:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447413:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447418:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447423:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447428:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447434:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447440:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447444:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447450:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447455:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447461:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447467:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447472:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447477:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447483:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447488:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447494:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447498:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447504:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447509:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447514:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447528:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447534:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447539:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447545:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447550:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447555:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447560:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447564:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447569:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447574:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447578:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447583:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447587:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447592:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447596:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447601:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447605:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447610:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447615:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447620:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447637:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447643:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447648:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447652:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.447657:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788744918.448912:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744918.448922:0:21364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788744918.448930:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce3afaff800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788744918.448934:0:21364:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3afaff800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788744918.448943:0:21364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788744918.448997:0:21364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce285a13800 1 00000020:00000080:0.0:1788744918.449004:0:21364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6e465a23bbc29721 00000020:00000080:0.0:1788744918.449010:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce3bd201800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788744918.449027:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788744918.449038:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744918.449044:0:21364:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788744918.449048:0:21364:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9ce2818e4d40) has no exports 00000020:00000080:1.0:1788744918.450397:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3bd201800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788744918.483271:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744918.483411:0:21364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788744918.483417:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce3936f6000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788744918.483422:0:21364:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce3936f6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788744918.483434:0:21364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788744918.484097:0:21364:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ce285a16800 00000020:01000000:1.0:1788744918.484131:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788744918.484136:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744918.484142:0:21364:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788744918.484146:0:21364:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9ce3c18e99c0) has no exports 00000020:00000080:1.0:1788744918.484167:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744918.484173:0:21364:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788744918.484177:0:21364:0:(genops.c:885:class_export_put()) final put ffff9ce287732000/OSS_uuid 00000020:00000080:1.0:1788744918.484179:0:21364:0:(genops.c:844:class_export_destroy()) destroying export ffff9ce287732000/OSS_uuid for OSS 00000020:01000000:1.0:1788744918.484183:0:21364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788744918.484513:0:17186:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788744918.485156:0:19179:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9ce2866d3800:19179] 3 exiting: rc = 0 00000100:00100000:3.0:1788744918.485225:0:18693:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9ce3a6d68800:18693] 0 exiting: rc = 1 00000100:00100000:1.0:1788744918.486774:0:18694:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9ce38fddde00:18694] 1 exiting: rc = 0 00000100:00100000:0.0:1788744918.487381:0:18695:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9ce3a6d68c00:18695] 2 exiting: rc = 0 00000100:00100000:1.0:1788744918.487551:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487564:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487570:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487576:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487582:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487589:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487596:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487614:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487620:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487637:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487647:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487653:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487658:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487664:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487670:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487679:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487685:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487695:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487700:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487706:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487711:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487716:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487722:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487728:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487737:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487742:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487747:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487753:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487759:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487764:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487770:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487775:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487781:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487786:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487792:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487797:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487802:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487809:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487815:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487834:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487843:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487849:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487862:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487868:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487873:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487878:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487888:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487894:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487899:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487924:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487933:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487941:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487946:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487952:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487957:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487975:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487983:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487988:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487994:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.487999:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.488004:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.488010:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.488017:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744918.488026:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.491971:0:18696:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ce38fddc600:18696] 0 exiting: rc = 1 00000100:00100000:0.0:1788744918.492100:0:18697:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ce38fdddc00:18697] 1 exiting: rc = 0 00000100:00100000:0.0:1788744918.492159:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492166:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492171:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492177:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492182:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492187:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492192:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492196:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492202:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492207:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492213:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492220:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492229:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492238:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492657:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492663:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492669:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492674:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492681:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492686:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492692:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492697:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492702:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492707:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492712:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492717:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492722:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492726:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492731:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492858:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492867:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492872:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492877:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492882:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492887:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492892:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492897:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492902:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492907:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492912:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492917:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492924:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492928:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492933:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492937:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492942:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492947:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492951:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492956:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492960:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492965:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492970:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492974:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492978:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492983:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492993:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.492999:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.493004:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.493010:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.493015:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.493021:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.493027:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.493032:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744918.493037:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.495160:0:18698:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ce288049200:18698] 0 exiting: rc = 1 00000100:00100000:0.0:1788744918.496636:0:18699:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ce288048000:18699] 1 exiting: rc = 0 00000100:00100000:0.0:1788744918.497074:0:18700:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ce288048200:18700] 2 exiting: rc = 0 00000100:00100000:2.0:1788744918.501210:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501221:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501227:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501233:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501239:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501378:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501386:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501408:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501414:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501421:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501427:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501433:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501439:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501445:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501453:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501461:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501469:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501554:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501563:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501569:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501574:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501580:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501586:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501591:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501597:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501602:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501609:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501615:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501621:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501656:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501665:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501672:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501678:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501683:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501689:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501695:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501701:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501707:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501713:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501719:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501724:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501729:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501758:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501766:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501772:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501779:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501785:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501800:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501814:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501823:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501828:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501843:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501850:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501856:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501871:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501890:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501897:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501903:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501909:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501915:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501920:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501926:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501932:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.501937:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.517658:0:18701:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ce288048a00:18701] 0 exiting: rc = 1 00000100:00100000:0.0:1788744918.519365:0:18702:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ce288048e00:18702] 1 exiting: rc = 0 00000100:00100000:3.0:1788744918.520102:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520114:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520121:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520127:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520132:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520138:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520144:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520149:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520155:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520160:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520166:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520172:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520178:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520184:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520190:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520195:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520201:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520207:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520214:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520238:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520277:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520284:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520290:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520296:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520302:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520309:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520315:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520332:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520339:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520345:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520351:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520356:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520364:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520371:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520380:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520386:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520392:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520398:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520404:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520410:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520416:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520424:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520429:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520434:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520440:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520445:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520450:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520456:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520462:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520469:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520485:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520491:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520497:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520504:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520518:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520524:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520530:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520536:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520566:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520574:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520581:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520588:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520593:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.520598:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744918.521392:0:18704:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ce288049000:18704] 1 exiting: rc = 0 00000100:00100000:0.0:1788744918.522817:0:18703:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ce288049e00:18703] 0 exiting: rc = 1 00000100:00100000:2.0:1788744918.523024:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523034:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523039:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523045:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523052:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523058:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523064:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523070:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523076:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523100:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523107:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523113:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523134:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523140:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523146:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523153:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523159:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523166:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523172:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523178:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523184:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523205:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523213:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523219:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523225:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523231:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523237:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523271:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523279:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523285:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523292:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523298:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523305:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523432:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523442:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523448:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523454:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523461:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523467:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523473:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523479:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523485:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523490:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523496:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523502:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523522:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523529:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523545:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523551:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523558:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523565:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523572:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523577:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523584:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523589:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523596:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523602:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523622:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523642:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523648:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523654:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523660:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523666:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744918.523672:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788744918.554894:0:21364:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788744939.851087:0:22129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788744950.694433:0:22729:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744950.694438:0:22729:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788744950.694439:0:22729:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788744950.694572:0:22729:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ce3ba964000 00000020:01000004:3.0:1788744950.694585:0:22729:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788744950.694592:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788744950.694604:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ce388af99c0) 00000020:00000080:3.0:1788744950.694615:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788744950.727436:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788744950.727901:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.733302:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.735357:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788744950.735873:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.736236:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.736732:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.736933:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788744950.737281:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788744950.737474:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.737782:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.738132:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788744950.738418:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788744950.738775:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.738985:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788744950.739900:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.740381:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.740650:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.740905:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.741267:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.741560:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.741843:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.742205:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.742507:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.742755:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.742942:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.743327:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.743624:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.743891:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.744432:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.744751:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.744941:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.745298:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.745602:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.745948:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.746328:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.746594:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.746831:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.747197:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.747497:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.747754:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.747924:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.748315:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.748571:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.748772:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.748953:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788744950.749286:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788744950.749823:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.750302:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.751332:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.751896:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788744950.752224:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788744950.752844:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:0.0:1788744950.753815:0:22729:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788744950.754160:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788744950.754169:0:22729:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788744950.754182:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6e465a23bbc29bd5 00000020:01000004:0.0:1788744950.754189:0:22729:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788744950.754194:0:22729:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788744950.754199:0:22729:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce3ba964000 from MGS 00000020:01000004:0.0:1788744950.754203:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788744950.754213:0:22729:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ce2818e3380) 00000020:00000080:0.0:1788744950.754224:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788744950.754406:0:22729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce3ba964000 from MGS, refs=2 00080000:01000000:0.0:1788744950.754412:0:22729:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744950.754417:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6e465a23bbc29be3 00000100:00100000:0.0:1788744950.754720:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788744950.754853:0:22729:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788744950.754859:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788744950.755607:0:22729:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788744950.755615:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788744950.756563:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744950.756789:0:22729:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788744950.756795:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788744950.757421:0:22729:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788744950.757429:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788744950.757873:0:22729:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788744950.757879:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788744950.758908:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744950.758912:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744950.758914:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744950.759441:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744950.759444:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744950.759446:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744950.760090:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788744950.765457:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788744950.766512:0:22729:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788744950.768747:0:22741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788744950.768812:0:22729:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788744950.768863:0:22729:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744950.769846:0:22729:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788744950.770754:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744950.770931:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788744950.770938:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788744950.778763:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788744950.778783:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788744950.779921:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788744950.779932:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788744950.781148:0:22746:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788744950.781355:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788744950.781383:0:22729:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.146@tcp' 00000020:01000004:2.0:1788744950.781385:0:22729:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788744950.781428:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.146@tcp (typ=mgc) 00000020:00000080:2.0:1788744950.781442:0:22729:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.146@tcp (ffff9ce38fe919c0) 00000020:00000080:2.0:1788744950.781458:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788744950.781741:0:22729:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce3ba971000@MGC192.168.201.146@tcp: add connection 192.168.201.146@tcp at head 00010000:00010000:2.0:1788744950.781921:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.146@tcp-0 is initialized 00000040:01000000:2.0:1788744950.781927:0:22729:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788744950.791890:0:22747:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788744950.794179:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.146@tcp (uuid 67ac6e5d-33bb-4bd9-870a-bea61ee993d9) 00000020:00000080:0.0:1788744950.794206:0:22729:0:(genops.c:1384:class_connect()) connect: client 67ac6e5d-33bb-4bd9-870a-bea61ee993d9, cookie 0x6e465a23bbc29bf1 00000100:00080000:0.0:1788744950.794218:0:22729:0:(import.c:545:import_select_connection()) MGC192.168.201.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744950.794230:0:22729:0:(import.c:666:import_select_connection()) MGC192.168.201.146@tcp: import ffff9ce3ba971000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1788744950.794286:0:22729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bcf7f100 x1875634419897344/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744950.794312:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 67ac6e5d-33bb-4bd9-870a-bea61ee993d9->MGS 00000020:01000004:0.0:1788744950.794334:0:22729:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788744950.794338:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788744950.794350:0:22729:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ce2818e19c0) 00000020:00000080:0.0:1788744950.794358:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788744950.795101:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3633:1875634419897344:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788744950.795161:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744950.795222:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419897344 00000100:00100000:2.0:1788744950.795229:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419897344 00000100:00100000:2.0:1788744950.795265:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744950.795270:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3633:x1875634419897344:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788744950.795292:0:22742:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 67ac6e5d-33bb-4bd9-870a-bea61ee993d9@0@lo t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:2.0:1788744950.795312:0:22742:0:(genops.c:1384:class_connect()) connect: client 67ac6e5d-33bb-4bd9-870a-bea61ee993d9, cookie 0x6e465a23bbc29bff 00000100:00080000:2.0:1788744950.795412:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9ce3ba974800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744950.795452:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+5:3633:x1875634419897344:12345-0@lo:250:mount.lustre.0 Request processed in 182us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744950.795458:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744950.795491:0:3633:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788744950.795497:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.146@tcp: connect to target with instance 0 00000100:00080000:2.0:1788744950.795502:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788744950.795505:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788744950.795508:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3ba971000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788744950.795509:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788744950.795514:0:3633:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788744950.795518:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3633:1875634419897344:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788744950.823438:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744950.823786:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788744950.823794:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788744950.829078:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788744950.829096:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788744950.840405:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744950.840418:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788744950.841995:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744950.842600:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788744950.842607:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788744950.844399:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788744950.844411:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788744950.894587:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744950.894819:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788744950.894827:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788744950.897974:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788744950.897993:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788744950.906968:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744950.907194:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788744950.907201:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788744950.910238:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744950.910286:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788744950.911074:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744950.911405:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788744950.911412:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788744950.911978:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744950.911986:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788744950.913704:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744950.913865:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788744950.913870:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788744950.917400:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744950.917419:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788744950.937419:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744950.937752:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744950.937761:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788744950.939383:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788744950.939394:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788744950.941671:0:22729:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744950.941692:0:22729:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788744950.942765:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788744950.942802:0:22729:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788744950.942809:0:22729:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788744950.942924:0:22729:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788744950.942960:0:22729:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.146@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788744950.942964:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788744950.942965:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744950.942966:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744950.942968:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744950.942969:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744950.942970:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744950.942971:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744950.942972:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744950.942974:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744950.942975:0:22729:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744950.942977:0:22729:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788744950.942979:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744950.942980:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744950.942982:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744950.942982:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744950.942983:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744950.942984:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744950.942985:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744950.942986:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744950.942987:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744950.942988:0:22729:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744950.943014:0:22729:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788744950.943033:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744950.943200:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744950.943377:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3945579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744950.943458:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419897472 00000100:00100000:0.0:1788744950.943467:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419897472 00000100:00100000:0.0:1788744950.943635:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744950.943646:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+5:22729:x1875634419897472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788744950.943694:0:22745:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744950.943697:0:22745:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788744950.943701:0:22745:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788744950.944006:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788744950.944617:0:22745:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788744950.946710:0:22767:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788744950.946717:0:22767:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788744950.946720:0:22767:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788744950.946723:0:22767:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788744950.947030:0:22767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788744950.947241:0:22745:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744950.947283:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788744950.950236:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+5:22729:x1875634419897472:12345-0@lo:253:mount.lustre.0 Request processed in 6584us (7027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744950.950287:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744950.951685:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897472:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788744950.951704:0:22729:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788744950.951708:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744950.951710:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744950.951723:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744950.951724:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744950.951726:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744950.951727:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744950.951728:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744950.951730:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744950.951732:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744950.951733:0:22729:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744950.951752:0:22729:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce3ba964000 from lustre-MDT0000 10000000:01000000:3.0:1788744950.951787:0:22729:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788744950.951790:0:22729:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744950.951795:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ce38fe919c0 10000000:01000000:3.0:1788744950.951799:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744950.951808:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ce38fe919c0 from 1 10000000:01000000:3.0:1788744950.951811:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744950.951850:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.951862:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.951872:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744950.951891:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744950.951938:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744950.958101:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce394557f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744950.961811:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419897600 00000100:00100000:2.0:1788744950.961828:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419897600 00000100:00100000:2.0:1788744950.961899:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744950.961911:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+5:22729:x1875634419897600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744950.961930:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744950.961955:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3813f3c00/0x6e465a23bbc29c0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29c06 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.961984:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3813f3c00/0x6e465a23bbc29c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29c06 expref: 6 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.961996:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3813f3c00/0x6e465a23bbc29c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29c06 expref: 6 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.962006:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3813f3c00, rc 0) 00000100:00100000:2.0:1788744950.962111:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+6:22729:x1875634419897600:12345-0@lo:101:mount.lustre.0 Request processed in 202us (10172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744950.962119:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744950.962282:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744950.962301:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.962310:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744950.962419:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744950.962455:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744950.962502:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce394557f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744950.963741:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419897728 00000100:00100000:2.0:1788744950.963752:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419897728 00000100:00100000:2.0:1788744950.963790:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744950.963809:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+6:22729:x1875634419897728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744950.963929:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+6:22729:x1875634419897728:12345-0@lo:501:mount.lustre.0 Request processed in 121us (1473us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744950.963936:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744950.964017:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897728:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788744950.964055:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788744950.964085:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.964104:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744950.964113:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce3ba964000 10000000:01000000:3.0:1788744950.964118:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788744950.964122:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ce3ba964000 10000000:01000000:3.0:1788744950.964125:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788744950.964128:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ce3ba964000 from 1 10000000:01000000:3.0:1788744950.964131:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788744950.964157:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491a00/0x6e465a23bbc29c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.964166:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce381491a00/0x6e465a23bbc29c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.964173:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce381491a00/0x6e465a23bbc29c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744950.964189:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744950.964228:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744950.964279:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce394557f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744950.964335:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419897856 00000100:00100000:2.0:1788744950.964340:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419897856 00000100:00100000:2.0:1788744950.964359:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744950.964365:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+6:22729:x1875634419897856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744950.964374:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744950.964387:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3813f3000/0x6e465a23bbc29c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29c14 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.964408:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3813f3000/0x6e465a23bbc29c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29c14 expref: 7 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.964418:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3813f3000/0x6e465a23bbc29c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29c14 expref: 7 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.964426:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3813f3000, rc 0) 00000100:00100000:2.0:1788744950.964464:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+7:22729:x1875634419897856:12345-0@lo:101:mount.lustre.0 Request processed in 99us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744950.964471:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744950.964601:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744950.964615:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce381491a00/0x6e465a23bbc29c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c1b expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.964623:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce381491a00/0x6e465a23bbc29c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29c1b expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744950.964636:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788744950.964658:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491a00/0x6e465a23bbc29c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c1b expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.964665:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce381491a00/0x6e465a23bbc29c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c1b expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744950.964671:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744950.964675:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744950.964679:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ce3ba964000 10000000:01000000:3.0:1788744950.964682:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788744950.964685:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788744950.964687:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744950.964701:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381490000/0x6e465a23bbc29c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.964708:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce381490000/0x6e465a23bbc29c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.964714:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce381490000/0x6e465a23bbc29c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744950.964732:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744950.964757:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744950.964778:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce394557f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744950.964882:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419897984 00000100:00100000:2.0:1788744950.964887:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419897984 00000100:00100000:2.0:1788744950.964906:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744950.964912:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+7:22729:x1875634419897984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744950.964920:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744950.964928:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3813f3a00/0x6e465a23bbc29c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29c22 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.964949:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3813f3a00/0x6e465a23bbc29c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29c22 expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.964956:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3813f3a00/0x6e465a23bbc29c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29c22 expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744950.964962:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3813f3a00, rc 0) 00000100:00100000:2.0:1788744950.965000:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+8:22729:x1875634419897984:12345-0@lo:101:mount.lustre.0 Request processed in 87us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744950.965006:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744950.965185:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419897984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744950.965196:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce381490000/0x6e465a23bbc29c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c29 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744950.965204:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce381490000/0x6e465a23bbc29c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29c29 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744950.965282:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419898112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744950.965310:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744950.965321:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce394557f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744950.965374:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419898112 00000100:00100000:2.0:1788744950.965379:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419898112 00000100:00100000:2.0:1788744950.965397:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744950.965404:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+8:22729:x1875634419898112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744950.965593:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:22729:x1875634419898112:12345-0@lo:501:mount.lustre.0 Request processed in 188us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744950.965600:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744950.965722:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419898112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744950.965749:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419898240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744950.965787:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744950.965816:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce394557f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744950.965906:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419898240 00000100:00100000:2.0:1788744950.965911:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419898240 00000100:00100000:2.0:1788744950.965929:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744950.965935:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:22729:x1875634419898240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744950.968637:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:22729:x1875634419898240:12345-0@lo:503:mount.lustre.0 Request processed in 2692us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744950.968801:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419898240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744950.968916:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744950.971825:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22768:1875634419898368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744950.971913:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744950.971978:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a19edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744950.972048:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419898368 00000100:00100000:3.0:1788744950.972068:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419898368 00000100:00100000:3.0:1788744950.972126:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744950.972134:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:22768:x1875634419898368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744950.973030:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:22768:x1875634419898368:12345-0@lo:502:llog_process_th.0 Request processed in 894us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744950.973050:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744950.975290:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22768:1875634419898368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744950.975339:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744950.975352:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744950.975354:0:22768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788744950.975359:0:22768:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788744950.975363:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744950.975379:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ce38fe94d40) 00000020:00000080:2.0:1788744950.975401:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788744950.975406:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788744950.975529:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788744950.975537:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6e465a23bbc29c37 00000020:00000080:2.0:1788744950.975758:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788744950.975763:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744950.975767:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744950.975768:0:22768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788744950.975771:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744950.975775:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744950.975776:0:22768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788744950.975780:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744950.975787:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ce38fe93380) 00000020:00000080:2.0:1788744950.975796:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788744950.975800:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788744950.975802:0:22768:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788744950.975805:0:22768:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788744950.975810:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788744950.975854:0:22768:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce3ba964000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788744950.975866:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ce38fe90000) 00000020:00000080:2.0:1788744950.975875:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788744950.975923:0:22768:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788744950.975929:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6e465a23bbc29c4c 00000020:00000080:2.0:1788744950.976011:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788744950.976023:0:22768:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788744950.976027:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6e465a23bbc29c53 00080000:01000000:2.0:1788744950.976031:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788744950.976034:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6e465a23bbc29c5a 00010000:00010000:0.0:1788744951.107604:0:22768:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788744951.109882:0:22768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:0.0:1788744951.110406:0:22768:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788744951.112940:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ce2818e4d40) 00000020:00000080:0.0:1788744951.112963:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788744951.113049:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788744951.113065:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6e465a23bbc29c68 00000020:00000080:0.0:1788744951.114709:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788744951.121054:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6e465a23bbc29c6f 00000020:00000080:0.0:1788744951.121535:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788744951.121558:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744951.121565:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744951.121568:0:22768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788744951.121571:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788744951.121575:0:22768:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788744951.121577:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788744951.121578:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788744951.121580:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788744951.121582:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744951.121584:0:22768:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788744951.121586:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744951.121592:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744951.121593:0:22768:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788744951.121598:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788744951.121636:0:22768:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788744951.121663:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744951.121667:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744951.121668:0:22768:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788744951.121671:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744951.121674:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744951.121675:0:22768:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788744951.121677:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788744951.121683:0:22768:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:00000080:0.0:1788744951.121713:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744951.121729:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ce2818e0000) 00000020:00000080:0.0:1788744951.121742:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788744951.121747:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788744951.121798:0:22768:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788744951.121803:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788744951.121811:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6e465a23bbc29c7d 00010000:00080000:0.0:1788744951.121843:0:22768:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce3c18fc000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:0.0:1788744951.123468:0:22768:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788744951.129668:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744951.129684:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788744951.129718:0:22768:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788744951.129738:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6e465a23bbc29c84 00000100:00080000:0.0:1788744951.129748:0:22768:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744951.129759:0:22768:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce3c18fc000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1788744951.129953:0:22768:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bcf7e680 x1875634419898496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744951.129980:0:22768:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788744951.130046:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744951.130050:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744951.130053:0:22768:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788744951.130069:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788744951.130072:0:22768:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788744951.130074:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788744951.130076:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788744951.130077:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788744951.130080:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744951.130081:0:22768:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788744951.130084:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788744951.130089:0:22768:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788744951.130093:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744951.130103:0:22768:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788744951.130108:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788744951.130112:0:22768:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:0.0:1788744951.130134:0:22768:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788744951.130137:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744951.130152:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ce3c18e99c0) 00000020:00000080:0.0:1788744951.130164:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788744951.130169:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788744951.130231:0:22768:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788744951.130237:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000100:00100000:3.0:1788744951.130309:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744951.130323:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419898624:0@lo:400:kworker.0 00000100:00100000:3.0:1788744951.130387:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744951.130438:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419898624 00000100:00100000:3.0:1788744951.130444:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419898624 00000100:00100000:2.0:1788744951.130588:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419898496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744951.130615:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744951.130625:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744951.130628:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:3634:x1875634419898624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744951.130726:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419898496 00000100:00100000:2.0:1788744951.130730:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419898496 00000100:00100000:2.0:1788744951.130758:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744951.130763:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1875634419898496:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788744951.130788:0:22755:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788744951.130841:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:3634:x1875634419898624:12345-0@lo:400:kworker.0 Request processed in 216us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744951.130849:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744951.130894:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419898624:0@lo:400:kworker.0 00000020:00000080:0.0:1788744951.131026:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6e465a23bbc29c92 00010000:00080000:0.0:1788744951.131065:0:22768:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce287a2e800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:0.0:1788744951.131320:0:22768:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788744951.138540:0:22768:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788744951.139207:0:22768:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788744951.149382:0:22768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744951.150420:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:2.0:1788744951.154198:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1875634419898496:12345-0@lo:38:llog_process_th.0 Request processed in 23425us (23563us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744951.154211:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788744951.154348:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744951.154354:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788744951.154359:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419898496:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788744951.154451:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788744951.155571:0:22774:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788744951.155576:0:22774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788744951.156465:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744951.156478:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788744951.156515:0:22768:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788744951.156535:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6e465a23bbc29c99 00000100:00080000:3.0:1788744951.156544:0:22768:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744951.156556:0:22768:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce287a2e800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744951.156590:0:22768:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb1c00 x1875634419898752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744951.156628:0:22768:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788744951.156656:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419898752:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788744951.156701:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000400:00000100:0.0:1788744951.156703:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419898752 offset 0 length 520: 4 00000020:00000080:3.0:1788744951.156704:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744951.156706:0:22768:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788744951.156709:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788744951.156712:0:22768:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788744951.156714:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744951.156715:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744951.156717:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788744951.156719:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744951.156720:0:22768:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788744951.156723:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788744951.156726:0:22768:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788744951.156729:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744951.156730:0:22768:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788744951.156733:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788744951.156736:0:22768:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:3.0:1788744951.156756:0:22768:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788744951.156759:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744951.156771:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ce388afcd40) 00000020:00000080:3.0:1788744951.156783:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788744951.156789:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788744951.156848:0:22768:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788744951.156853:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788744951.156859:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6e465a23bbc29ca7 00010000:00080000:3.0:1788744951.156887:0:22768:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce392b85000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1788744951.157083:0:22768:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788744951.157374:0:22768:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788744951.157388:0:22768:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788744951.163858:0:22768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744951.164157:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788744951.164378:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788744951.165087:0:22776:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788744951.165097:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788744951.167516:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744951.167534:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788744951.167900:0:22768:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788744951.167923:0:22768:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6e465a23bbc29cae 00000100:00080000:1.0:1788744951.167934:0:22768:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744951.167945:0:22768:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce392b85000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788744951.167979:0:22768:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce2882f7100 x1875634419898880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744951.168050:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419898880:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788744951.168130:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419898880 offset 0 length 520: 4 00000100:00080000:1.0:1788744951.168229:0:22768:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788744951.168324:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744951.168329:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744951.168332:0:22768:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788744951.168334:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744951.168338:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744951.168339:0:22768:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788744951.168342:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788744951.168344:0:22768:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788744951.168346:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744951.168348:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744951.168350:0:22768:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788744951.168352:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744951.168354:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744951.168356:0:22768:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788744951.168359:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788744951.168387:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22768:1875634419899008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744951.168443:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744951.168494:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce393323c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744951.168729:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419899008 00000100:00100000:2.0:1788744951.168737:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419899008 00000100:00100000:2.0:1788744951.168785:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744951.168794:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:22768:x1875634419899008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744951.168920:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:22768:x1875634419899008:12345-0@lo:502:llog_process_th.0 Request processed in 127us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744951.168928:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744951.168947:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22768:1875634419899008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744951.168971:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744951.168976:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744951.168977:0:22768:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788744951.168981:0:22768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788744951.169108:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788744951.169133:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788744951.169154:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381490000/0x6e465a23bbc29c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c29 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.169165:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce381490000/0x6e465a23bbc29c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c29 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744951.169174:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3ba964000 from 1 10000000:01000000:3.0:1788744951.169177:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744951.169201:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.169207:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.169214:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744951.169223:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744951.169277:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744951.169320:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419899136 00000100:00100000:0.0:1788744951.169325:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419899136 00000100:00100000:0.0:1788744951.169358:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744951.169366:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+9:22729:x1875634419899136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744951.169375:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744951.169388:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29cb5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.169420:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 10 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.169432:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 10 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.169441:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf7a00, rc 0) 00000100:00100000:1.0:1788744951.169723:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3945de840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744951.169884:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+10:22729:x1875634419899136:12345-0@lo:101:mount.lustre.0 Request processed in 516us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744951.169890:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744951.169957:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744951.169971:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744951.169981:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744951.170892:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899264:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788744951.170946:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744951.170988:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce393323c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744951.171013:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419899264 00000100:00100000:2.0:1788744951.171019:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419899264 00000100:00100000:2.0:1788744951.171102:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744951.171115:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+10:22729:x1875634419899264:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788744951.171133:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788744951.171138:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788744951.171232:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+10:22729:x1875634419899264:12345-0@lo:256:mount.lustre.0 Request processed in 122us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744951.171240:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744951.171423:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899264:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788744951.171992:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788744951.172077:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744951.172088:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744951.172108:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce3ba964000 from 1 10000000:01000000:1.0:1788744951.172111:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744951.172144:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744951.172208:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744951.172219:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744951.172239:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744951.172301:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744951.172344:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce393323c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744951.172416:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419899392 00000100:00100000:3.0:1788744951.172423:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419899392 00000100:00100000:3.0:1788744951.172468:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744951.172476:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+10:22729:x1875634419899392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744951.172488:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744951.172508:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29cc3 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.172530:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 11 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.172540:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 11 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.172548:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce381490e00, rc 0) 00000100:00100000:3.0:1788744951.172597:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22729:x1875634419899392:12345-0@lo:101:mount.lustre.0 Request processed in 121us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744951.172604:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744951.172639:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744951.172654:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.172663:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744951.172741:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744951.172783:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744951.172803:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3924730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744951.172829:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419899520 00000100:00100000:3.0:1788744951.172834:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419899520 00000100:00100000:3.0:1788744951.172947:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744951.172956:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22729:x1875634419899520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744951.173110:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22729:x1875634419899520:12345-0@lo:501:mount.lustre.0 Request processed in 155us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744951.173117:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744951.173175:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744951.173204:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744951.173276:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744951.173890:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3933236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744951.173980:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419899648 00000100:00100000:0.0:1788744951.173987:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419899648 00000100:00100000:0.0:1788744951.174019:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744951.174028:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22729:x1875634419899648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744951.174827:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22729:x1875634419899648:12345-0@lo:503:mount.lustre.0 Request processed in 798us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744951.174846:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744951.175403:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419899648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744951.176336:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22778:1875634419899776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744951.176398:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744951.176445:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a19ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744951.176503:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419899776 00000100:00100000:0.0:1788744951.176510:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419899776 00000100:00100000:0.0:1788744951.176545:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788744951.176554:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22778:x1875634419899776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744951.177378:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22778:x1875634419899776:12345-0@lo:502:llog_process_th.0 Request processed in 823us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744951.177386:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744951.177483:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22778:1875634419899776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744951.177511:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744951.177521:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744951.177524:0:22778:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788744951.177532:0:22778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce3ba964000 00000020:00000080:2.0:1788744951.177534:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744951.177542:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744951.177545:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744951.177546:0:22778:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788744951.177548:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744951.177551:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744951.177552:0:22778:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788744951.177555:0:22778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce3ba964000 00000020:00000080:2.0:1788744951.177557:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744951.177622:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744951.177626:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744951.177628:0:22778:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788744951.177630:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744951.177633:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744951.177634:0:22778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744951.177648:0:22778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce3ba964000 00000020:00000080:2.0:1788744951.177650:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744951.177670:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744951.177680:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744951.177682:0:22778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744951.177685:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744951.177688:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744951.177690:0:22778:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788744951.177693:0:22778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce3ba964000 00000020:00000080:2.0:1788744951.177695:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788744951.177738:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22778:1875634419899904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744951.177775:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744951.177814:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a19ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744951.177914:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419899904 00000100:00100000:0.0:1788744951.177920:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419899904 00000100:00100000:0.0:1788744951.177950:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744951.177957:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22778:x1875634419899904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744951.178032:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22778:x1875634419899904:12345-0@lo:502:llog_process_th.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744951.178036:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744951.178111:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22778:1875634419899904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744951.178129:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744951.178132:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744951.178134:0:22778:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788744951.178138:0:22778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788744951.178409:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788744951.178432:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744951.178448:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.178457:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744951.178508:0:22729:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788744951.178511:0:22729:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce3ba964000 10000000:01000000:0.0:1788744951.178514:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce3ba964000 10000000:01000000:0.0:1788744951.178518:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744951.178530:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ce3ba964000 from 1 10000000:01000000:0.0:1788744951.178534:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744951.178561:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7600/0x6e465a23bbc29cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.178569:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7600/0x6e465a23bbc29cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.178579:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7600/0x6e465a23bbc29cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744951.178593:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419900032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744951.178625:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744951.178950:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419900032 00000100:00100000:1.0:1788744951.178956:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419900032 00000100:00100000:0.0:1788744951.178968:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392473600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744951.178997:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744951.179006:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22729:x1875634419900032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744951.179016:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744951.179030:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3c21c8200/0x6e465a23bbc29cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29cd1 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744951.179066:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3c21c8200/0x6e465a23bbc29cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29cd1 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744951.179078:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3c21c8200/0x6e465a23bbc29cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29cd1 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744951.179276:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3c21c8200, rc 0) 00000100:00100000:1.0:1788744951.179315:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22729:x1875634419900032:12345-0@lo:101:mount.lustre.0 Request processed in 311us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744951.179321:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744951.179859:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419900032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744951.179878:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7600/0x6e465a23bbc29cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cd8 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.179888:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7600/0x6e465a23bbc29cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29cd8 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744951.179951:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419900160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744951.179979:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744951.180010:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392473600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744951.180016:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419900160 00000100:00100000:1.0:1788744951.180022:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419900160 00000100:00100000:1.0:1788744951.180070:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744951.180079:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22729:x1875634419900160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744951.180789:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22729:x1875634419900160:12345-0@lo:501:mount.lustre.0 Request processed in 710us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744951.180796:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744951.181048:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419900160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744951.181108:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419900288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744951.181155:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744951.181199:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392473600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744951.181338:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419900288 00000100:00100000:1.0:1788744951.181345:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419900288 00000100:00100000:1.0:1788744951.181374:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744951.181382:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22729:x1875634419900288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744951.181474:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22729:x1875634419900288:12345-0@lo:503:mount.lustre.0 Request processed in 92us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744951.181481:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744951.181551:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419900288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744951.181941:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22779:1875634419900416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744951.181979:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744951.182011:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3945de600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744951.182053:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419900416 00000100:00100000:1.0:1788744951.182067:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419900416 00000100:00100000:3.0:1788744951.182259:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744951.182268:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22779:x1875634419900416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744951.182363:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22779:x1875634419900416:12345-0@lo:502:llog_process_th.0 Request processed in 96us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744951.182375:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744951.182414:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22779:1875634419900416:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788744951.182470:0:22779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788744951.182488:0:22779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ce388afb380) 00000020:00000080:3.0:1788744951.182508:0:22779:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788744951.182587:0:22779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce3ba964000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788744951.182592:0:22779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce3ba964000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788744951.182594:0:22779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3ba964000 4 00010000:00080000:3.0:1788744951.182625:0:22779:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce3a6de9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1788744951.191523:0:22779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788744951.192407:0:22779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788744951.192453:0:22779:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788744951.192468:0:22779:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6e465a23bbc29ce6 00000100:00080000:3.0:1788744951.192480:0:22779:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744951.192492:0:22779:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ce3a6de9800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744951.192530:0:22779:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb1180 x1875634419900544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744951.192555:0:22779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744951.192999:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875634419900544:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744951.193088:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744951.193308:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419900544 00000100:00100000:3.0:1788744951.193317:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419900544 00000100:00100000:3.0:1788744951.193353:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744951.193361:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419900544:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744951.193417:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419900544:12345-0@lo:38:llog_process_th.0 Request processed in 55us (330us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788744951.193425:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744951.193509:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744951.193517:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3a6de9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744951.193524:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788744951.193527:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875634419900544:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744951.196933:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22779:1875634419900672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744951.197020:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744951.197078:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3945de300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744951.198751:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419900672 00000100:00100000:2.0:1788744951.198765:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419900672 00000100:00100000:2.0:1788744951.198823:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744951.198835:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22779:x1875634419900672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744951.199079:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22779:x1875634419900672:12345-0@lo:502:llog_process_th.0 Request processed in 246us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744951.199089:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744951.200756:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22779:1875634419900672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744951.200841:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22779:1875634419900800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744951.200905:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744951.202109:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3945de300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744951.204266:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419900800 00000100:00100000:2.0:1788744951.204284:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419900800 00000100:00100000:2.0:1788744951.204349:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744951.204359:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22779:x1875634419900800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744951.205091:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22779:x1875634419900800:12345-0@lo:502:llog_process_th.0 Request processed in 731us (4183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744951.205108:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788744951.205219:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22779:1875634419900800:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788744951.205277:0:22779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788744951.205705:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788744951.205733:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744951.205749:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7600/0x6e465a23bbc29cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cd8 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744951.205761:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7600/0x6e465a23bbc29cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cd8 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744951.205808:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744951.205810:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788744951.205811:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744951.205812:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744951.205814:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744951.205816:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744951.205817:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744951.205818:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788744951.205821:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744951.205823:0:22729:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744951.205827:0:22729:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788744951.205829:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744951.205830:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788744951.205831:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744951.205832:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744951.205833:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744951.205835:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744951.205836:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744951.205837:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788744951.205838:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744951.205839:0:22729:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744951.205861:0:22729:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788744951.205879:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419900928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744951.205925:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744951.205956:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afabe600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744951.205983:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419900928 00000100:00100000:2.0:1788744951.205989:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419900928 00000100:00100000:2.0:1788744951.206022:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744951.206030:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22729:x1875634419900928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788744951.206066:0:22745:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788744951.206081:0:22745:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788744951.212373:0:22745:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744951.212434:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788744951.212760:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22729:x1875634419900928:12345-0@lo:253:mount.lustre.0 Request processed in 6726us (6830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744951.212773:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:2.0:1788744951.214360:0:22766:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744951.214370:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788744951.214393:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744951.214414:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 11 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744951.214423:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744951.214727:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 11 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744951.214745:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 11 pid: 22742 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744951.214759:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419901056:0@lo:104: 00000100:00100000:2.0:1788744951.214826:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744951.214920:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afabe840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744951.214959:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22729:1875634419900928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744951.214970:0:22729:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788744951.214974:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744951.214975:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788744951.214982:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744951.214984:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744951.214985:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744951.214986:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744951.214988:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744951.214989:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788744951.214991:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744951.214993:0:22729:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788744951.215005:0:22729:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788744951.218855:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419901056 00000100:00100000:3.0:1788744951.218873:0:22733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419901056 00000100:00100000:3.0:1788744951.218943:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744951.218955:0:22733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:22766:x1875634419901056:12345-0@lo:104: 00010000:00010000:3.0:1788744951.218975:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220266:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744951.220277:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220289:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce381490600 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:0.0:1788744951.220294:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220304:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744951.220312:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.220315:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 10000000:01000000:0.0:1788744951.220318:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788744951.220323:0:22733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:22766:x1875634419901056:12345-0@lo:104: Request processed in 1370us (5496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744951.220331:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788744951.220360:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220366:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744951.220388:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744951.220391:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419901056:0@lo:104: 00010000:00010000:0.0:1788744951.220395:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce381490600/0x6e465a23bbc29cb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cbc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.220414:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220422:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744951.220424:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744951.220426:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744951.220457:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744951.220469:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419901184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744951.220718:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744951.220783:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419901184 00000100:00100000:0.0:1788744951.220790:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419901184 00010000:00010000:0.0:1788744951.220813:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 12 pid: 22742 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744951.220847:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744951.220855:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:3637:x1875634419901184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744951.220867:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744951.220872:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 12 pid: 22742 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220883:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 12 pid: 22742 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220897:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc29cbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29cb5 expref: 12 pid: 22742 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220911:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220921:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788744951.220936:0:22735:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006566327s 00010000:00010000:0.0:1788744951.220941:0:22735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220958:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220966:0:22735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220973:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220979:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f3800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744951.220983:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.220991:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.221011:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744951.221022:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744951.221025:0:22766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.221033:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744951.221039:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3813f3800/0x6e465a23bbc29ced lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744951.221067:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:3637:x1875634419901184:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744951.221074:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744951.221080:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419901184:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788744951.242729:0:22729:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1788744951.243076:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788744951.243085:0:22790:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1788744951.243088:0:22790:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1788744951.243987:0:22791:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788744951.244025:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788744951.244780:0:22791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788744951.245865:0:22792:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ce3bd4c0a80 x1875634419901312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744951.245881:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000040:01000000:3.0:1788744951.246154:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788744951.246188:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788744951.246798:0:22729:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788744951.246808:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788744951.246856:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744951.248045:0:22729:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788744951.248627:0:22729:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788744951.248660:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788744951.251804:0:22729:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788744951.252452:0:22729:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:0.0:1788744951.254779:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788744951.254864:0:22791:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:2.0:1788744951.258809:0:22729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788744951.267022:0:22729:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788744951.267072:0:22729:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab0841503988 00100000:10000000:2.0:1788744951.267080:0:22729:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788744951.276835:0:22729:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788744951.276860:0:22729:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788744951.276885:0:22729:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788744951.276909:0:22729:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788744951.294315:0:22729:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788744951.294511:0:22729:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788744951.824418:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788744952.273888:0:22786:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788744952.273901:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788744952.278087:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000040:00080000:1.0:1788744952.280197:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788744952.280211:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:3.0:1788744952.466998:0:22747:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788744952.467005:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3ba964000 from 11 10000000:01000000:3.0:1788744952.467010:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744952.467066:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744952.467076:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744952.467088:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744952.467123:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419901440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744952.467234:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744952.467304:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce287884f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744952.467485:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419901440 00000100:00100000:0.0:1788744952.467493:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419901440 00000100:00100000:0.0:1788744952.467539:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744952.467560:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+11:22747:x1875634419901440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744952.467574:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744952.467589:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29cf4 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744952.467613:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744952.467625:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744952.467634:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf7000, rc 0) 00000100:00100000:0.0:1788744952.467686:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22747:x1875634419901440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744952.467694:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744952.467774:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419901440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744952.467790:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744952.467799:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744952.467852:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419901568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788744952.467884:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744952.467909:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744952.468087:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419901568 00000100:00100000:0.0:1788744952.468091:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419901568 00000100:00100000:0.0:1788744952.468134:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788744952.468141:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22747:x1875634419901568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788744952.468156:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744952.468175:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744952.468179:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788744952.468282:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:22747:x1875634419901568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744952.468289:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744952.468410:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419901568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788744952.468453:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788744952.468460:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744952.468469:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744952.849413:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744953.296313:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000040:00080000:1.0:1788744953.296811:0:22786:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788744953.296817:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744953.296956:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788744953.297000:0:22786:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744953.297177:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1788744953.878228:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744954.327236:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00010000:00010000:0.0:1788744954.898288:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744955.345355:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00010000:00010000:0.0:1788744955.921758:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744956.370045:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000100:00080000:2.0:1788744956.496615:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744956.496622:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788744956.496626:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744956.496634:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1788744956.496639:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744956.496651:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce3c18fc000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744956.496676:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c0700 x1875634419901824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744956.496712:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744956.496715:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744956.496718:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744956.496722:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744956.496724:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744956.496727:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788744956.496729:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce3a6de9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744956.496736:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ce3a6de9800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744956.496751:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c3480 x1875634419901952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744956.496792:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419901824:0@lo:38:kworker.0 00000100:00100000:2.0:1788744956.496919:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744956.496952:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875634419901952:0@lo:38:kworker.0 00000100:00100000:2.0:1788744956.497006:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744956.497157:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419901696:0@lo:400:kworker.0 00000100:00100000:3.0:1788744956.497207:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744956.497309:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419901824 00000100:00100000:3.0:1788744956.497316:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419901824 00000100:00100000:3.0:1788744956.497360:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744956.497368:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419901824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788744956.497386:0:22756:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788744956.497428:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419901824:12345-0@lo:38:kworker.0 Request processed in 59us (508us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744956.497435:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744956.497467:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419901952 00000100:00100000:3.0:1788744956.497471:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419901952 00000100:00100000:3.0:1788744956.497490:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744956.497494:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1875634419901952:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788744956.497521:0:22752:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:3.0:1788744956.497566:0:22752:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6e465a23bbc29d02 00000004:00100000:3.0:1788744956.497581:0:22752:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788744956.497717:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9ce288804000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744956.497761:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875634419901952:12345-0@lo:38:kworker.0 Request processed in 264us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744956.497768:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744956.498031:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419901696 00000100:00100000:2.0:1788744956.498037:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419901696 00000100:00100000:2.0:1788744956.498082:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744956.498092:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:3637:x1875634419901696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744956.498148:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:3637:x1875634419901696:12345-0@lo:400:kworker.0 Request processed in 58us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744956.498155:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744956.498223:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419901696:0@lo:400:kworker.0 00000100:00080000:2.0:1788744956.498293:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744956.498299:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744956.498302:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419901824:0@lo:38:kworker.0 00010000:00080000:2.0:1788744956.498315:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce3bd4c3480 x1875634419901952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744956.498328:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788744956.498335:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788744956.498339:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788744956.498342:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3a6de9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788744956.498347:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875634419901952:0@lo:38:kworker.0 00010000:00010000:3.0:1788744956.946441:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744957.392882:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000001:02000400:0.0:1788744957.504118:0:23035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788744957.972509:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744958.417046:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000020:00000004:1.0:1788744958.566050:0:23088:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788744958.566230:0:23088:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788744958.993147:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744959.442023:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000020:00000004:1.0:1788744959.464810:0:23138:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788744959.465141:0:23138:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744960.017820:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744960.470962:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00010000:00010000:3.0:1788744961.040933:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744961.488396:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000100:00100000:1.0:1788744961.617329:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744951/real 1788744951] req@ffff9ce2882f7100 x1875634419898880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744961.617362:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce2882f7100 x1875634419898880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744961.617374:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744951/real 1788744951] req@ffff9ce3a6bb1c00 x1875634419898752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744961.617386:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3a6bb1c00 x1875634419898752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788744961.617405:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744961.617432:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788744961.617436:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419898880:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788744961.617442:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce287a2e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744961.617447:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788744961.617450:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419898752:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788744961.617583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788744961.617588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788744961.617591:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744961.617596:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 681 00000100:00080000:3.0:1788744961.617601:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788744961.617611:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce3c18fc000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744961.617631:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb0380 x1875634419902208/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744961.617648:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744961.617651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788744961.617652:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce287a2e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744961.617655:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:3.0:1788744961.617657:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788744961.617661:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce287a2e800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744961.617673:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb1c00 x1875634419902336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744961.617690:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744961.617693:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788744961.617695:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744961.617698:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:3.0:1788744961.617700:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788744961.617704:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce392b85000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744961.617717:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb2300 x1875634419902464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744961.617749:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419902592:0@lo:400:kworker.0 00000100:00100000:3.0:1788744961.617812:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744961.617864:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744961.617870:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3635:1875634419902080:0@lo:400:kworker.0 00000100:00100000:3.0:1788744961.617910:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744961.617951:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419902592 00000100:00100000:3.0:1788744961.617959:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419902592 00000100:00100000:3.0:1788744961.618028:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744961.618036:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419902592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744961.618090:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419902592:12345-0@lo:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744961.618096:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744961.618118:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419902080 00000100:00100000:3.0:1788744961.618121:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419902080 00000100:00100000:3.0:1788744961.618143:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744961.618150:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:3635:x1875634419902080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744961.618177:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:3635:x1875634419902080:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744961.618189:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744961.618235:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3635:1875634419902080:0@lo:400:kworker.0 00010000:00080000:3.0:1788744961.618284:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce3a6bb1180 x1875634419902592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744961.618295:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419902592:0@lo:400:kworker.0 00000100:00100000:3.0:1788744961.618449:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419902208:0@lo:38:kworker.0 00000100:00100000:3.0:1788744961.618480:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744961.618498:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419902336:0@lo:8:kworker.0 00000400:00000100:3.0:1788744961.618517:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419902336 offset 0 length 520: 4 00000100:00100000:3.0:1788744961.618528:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419902464:0@lo:8:kworker.0 00000400:00000100:3.0:1788744961.618544:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419902464 offset 0 length 520: 4 00000100:00100000:3.0:1788744961.618564:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419902208 00000100:00100000:3.0:1788744961.618568:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419902208 00000100:00100000:3.0:1788744961.618589:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744961.618593:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419902208:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788744961.618609:0:22756:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788744961.618641:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419902208:12345-0@lo:38:kworker.0 Request processed in 46us (161us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744961.618647:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788744961.618673:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744961.618677:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744961.618681:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419902208:0@lo:38:kworker.0 00010000:00010000:0.0:1788744962.065077:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744962.515879:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00010000:00010000:3.0:1788744963.088402:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744963.536340:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000040:00080000:2.0:1788744963.537091:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788744964.115532:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744964.561186:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00010000:00010000:0.0:1788744965.139778:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744965.593589:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00010000:00010000:2.0:1788744966.166604:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744966.608566:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000100:00080000:2.0:1788744966.745444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744966.745452:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788744966.745457:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744966.745467:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 686 00000100:00080000:2.0:1788744966.745474:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788744966.745486:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce3c18fc000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744966.745508:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c0700 x1875634419902848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744966.745521:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744966.745525:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744966.745536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744966.745540:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744966.745586:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875634419902976:0@lo:400:kworker.0 00000100:00100000:2.0:1788744966.745653:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744966.745911:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419902720:0@lo:400:kworker.0 00000100:00100000:3.0:1788744966.745947:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744966.746009:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419902976 00000100:00100000:3.0:1788744966.746018:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419902976 00000100:00100000:3.0:1788744966.746063:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744966.746072:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875634419902976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744966.746118:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875634419902976:12345-0@lo:400:kworker.0 Request processed in 47us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744966.746125:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744966.746148:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419902720 00000100:00100000:3.0:1788744966.746152:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419902720 00000100:00100000:3.0:1788744966.746176:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744966.746182:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:3636:x1875634419902720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744966.746218:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:3636:x1875634419902720:12345-0@lo:400:kworker.0 Request processed in 36us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744966.746532:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419902848:0@lo:38:kworker.0 00000100:00100000:0.0:1788744966.746583:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744966.746626:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419902848 00000100:00100000:0.0:1788744966.746630:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419902848 00000100:00100000:0.0:1788744966.746656:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744966.746662:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419902848:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788744966.746809:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce3bd4c3b80 x1875634419902976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744966.746825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875634419902976:0@lo:400:kworker.0 00000100:00100000:3.0:1788744966.747879:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744966.747958:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419902720:0@lo:400:kworker.0 00010000:00020000:0.0:1788744966.748084:0:22756:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788744966.748148:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419902848:12345-0@lo:38:kworker.0 Request processed in 1485us (1564us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788744966.748157:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788744966.748462:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744966.748467:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744966.748471:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419902848:0@lo:38:kworker.0 00000020:01000004:2.0:1788744966.813642:0:23483:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788744966.813646:0:23483:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788744966.813647:0:23483:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788744966.813742:0:23483:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ce3bda7d000 00000020:01000004:2.0:1788744966.813756:0:23483:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788744966.813765:0:23483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788744966.813799:0:23483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ce3b39c8000) 00000020:00000080:2.0:1788744966.813817:0:23483:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788744966.877095:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.877466:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788744966.879931:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.880144:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.880867:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.881130:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.882006:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.882413:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.882731:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.882948:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.883183:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.883570:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.884507:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.885036:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.885444:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.886021:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.886424:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.887045:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.887433:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.887969:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.888768:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.889164:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.889721:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.889966:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.890187:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.890705:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.891177:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.891472:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.891771:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.892023:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.892428:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.892655:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.892806:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788744966.892980:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788744966.895138:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788744966.895683:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788744966.895961:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788744966.896260:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788744966.896698:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788744966.897109:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788744966.897423:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788744966.897727:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788744966.898029:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788744966.898293:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788744966.898697:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788744966.898905:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:01000000:2.0:1788744966.899893:0:23483:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788744966.900085:0:23483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788744966.900095:0:23483:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788744966.900105:0:23483:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6e465a23bbc29d10 00000020:01000004:2.0:1788744966.900111:0:23483:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788744966.900134:0:23483:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.146@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788744966.900136:0:23483:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788744966.900140:0:23483:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788744966.900160:0:23483:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788744966.900163:0:23483:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.146@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788744966.903172:0:23483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788744966.903204:0:23483:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.146@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788744966.903207:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788744966.903208:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744966.903209:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744966.903210:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744966.903211:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744966.903212:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744966.903213:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744966.903214:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744966.903214:0:23483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744966.903217:0:23483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788744966.903219:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744966.903220:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744966.903221:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744966.903222:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744966.903223:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744966.903224:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744966.903225:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744966.903226:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744966.903227:0:23483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744966.903323:0:23483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788744966.903340:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744966.903451:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.903496:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744966.903512:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419903104 00000100:00100000:3.0:1788744966.903520:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419903104 00000100:00100000:3.0:1788744966.903576:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744966.903585:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:23483:x1875634419903104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788744966.903615:0:22745:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788744966.903624:0:22745:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788744966.903632:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788744966.903880:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:23483:x1875634419903104:12345-0@lo:253:mount.lustre.0 Request processed in 295us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744966.903888:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744966.903976:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744966.903985:0:23483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788744966.903987:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744966.903988:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744966.903993:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744966.904005:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744966.904007:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744966.904008:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744966.904009:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744966.904010:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744966.904011:0:23483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744966.904027:0:23483:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce3bda7d000 from lustre-MDT0001 10000000:01000000:2.0:1788744966.904055:0:23483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788744966.904058:0:23483:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788744966.904065:0:23483:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce38fe919c0 local copy 00010000:00010000:2.0:1788744966.904075:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744966.904149:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744966.904176:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.904299:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744966.904579:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419903232 00000100:00100000:3.0:1788744966.904585:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419903232 00000100:00100000:3.0:1788744966.904662:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744966.904670:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:23483:x1875634419903232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744966.904764:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:23483:x1875634419903232:12345-0@lo:501:mount.lustre.0 Request processed in 95us (587us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744966.904771:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744966.904845:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903232:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788744966.904857:0:23483:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788744966.904875:0:23483:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788744966.904881:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.904891:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744966.904916:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce3bda7d000 10000000:01000000:2.0:1788744966.904922:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744966.904929:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ce38fe919c0 10000000:01000000:2.0:1788744966.904931:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788744966.904934:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ce38fe919c0 from 1 10000000:01000000:2.0:1788744966.904944:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788744966.904977:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2a00/0x6e465a23bbc29d17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.904988:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2a00/0x6e465a23bbc29d17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.905011:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2a00/0x6e465a23bbc29d17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744966.905032:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744966.905061:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.905506:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744966.905914:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419903360 00000100:00100000:0.0:1788744966.905924:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419903360 00000100:00100000:0.0:1788744966.905964:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744966.905972:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+12:23483:x1875634419903360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744966.905985:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744966.906166:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf6200/0x6e465a23bbc29d1e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29d17 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.906210:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf6200/0x6e465a23bbc29d1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29d17 expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.906353:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf6200/0x6e465a23bbc29d1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29d17 expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.906362:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf6200, rc 0) 00000100:00100000:0.0:1788744966.906555:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+13:23483:x1875634419903360:12345-0@lo:101:mount.lustre.0 Request processed in 583us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744966.906563:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744966.906630:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744966.906645:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2a00/0x6e465a23bbc29d17 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d1e expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.906653:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2a00/0x6e465a23bbc29d17 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29d1e expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744966.906670:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788744966.906725:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2a00/0x6e465a23bbc29d17 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d1e expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.906734:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2a00/0x6e465a23bbc29d17 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d1e expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744966.906745:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ce3bda7d000 10000000:01000000:2.0:1788744966.906751:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788744966.906764:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ce3bda7d000 from 1 10000000:01000000:2.0:1788744966.906766:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788744966.906800:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2000/0x6e465a23bbc29d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.906808:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2000/0x6e465a23bbc29d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.906816:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2000/0x6e465a23bbc29d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744966.906834:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744966.906866:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.906904:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744966.906952:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419903488 00000100:00100000:0.0:1788744966.906958:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419903488 00000100:00100000:0.0:1788744966.907005:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744966.907014:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+13:23483:x1875634419903488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744966.907022:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744966.907031:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf7400/0x6e465a23bbc29d2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29d25 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.907045:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf7400/0x6e465a23bbc29d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29d25 expref: 14 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.907053:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf7400/0x6e465a23bbc29d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29d25 expref: 14 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.907059:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf7400, rc 0) 00000100:00100000:0.0:1788744966.907083:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+14:23483:x1875634419903488:12345-0@lo:101:mount.lustre.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744966.907099:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788744966.907428:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744966.907439:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2000/0x6e465a23bbc29d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d2c expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.907448:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2000/0x6e465a23bbc29d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29d2c expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744966.907460:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788744966.907699:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2000/0x6e465a23bbc29d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d2c expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.907708:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2000/0x6e465a23bbc29d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d2c expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744966.907721:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788744966.907735:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744966.907740:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ce3bda7d000 10000000:01000000:2.0:1788744966.907743:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788744966.907747:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788744966.907749:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788744966.907770:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.907779:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.907797:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744966.907815:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744966.907854:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.907894:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744966.907955:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419903616 00000100:00100000:0.0:1788744966.907961:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419903616 00000100:00100000:0.0:1788744966.908095:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744966.908105:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+14:23483:x1875634419903616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744966.908117:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744966.908130:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf6600/0x6e465a23bbc29d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29d33 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.908147:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf6600/0x6e465a23bbc29d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29d33 expref: 15 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.908156:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf6600/0x6e465a23bbc29d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29d33 expref: 15 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744966.908164:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf6600, rc 0) 00000100:00100000:0.0:1788744966.908211:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419903616:12345-0@lo:101:mount.lustre.0 Request processed in 107us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744966.908335:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744966.908346:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d3a expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744966.908353:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29d3a expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744966.908709:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:2.0:1788744966.910104:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788744966.911551:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744966.915749:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788744966.915815:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788744966.915829:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788744966.915841:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788744966.915868:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788744966.915881:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788744966.915893:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788744966.915908:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788744966.915926:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788744966.915938:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788744966.915950:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788744966.915961:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788744966.915972:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788744966.915984:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788744966.916075:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788744966.916092:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788744966.916107:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788744966.916120:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788744966.916133:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788744966.916148:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788744966.916164:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788744966.916179:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788744966.916196:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788744966.916211:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788744966.916329:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788744966.916345:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788744966.916359:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788744966.916372:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788744966.916384:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788744966.916475:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788744966.916492:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788744966.916504:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788744966.916515:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788744966.916528:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788744966.916541:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788744966.916554:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788744966.916568:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788744966.916593:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788744966.916607:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788744966.916620:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788744966.916632:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788744966.916644:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788744966.916660:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788744966.916672:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788744966.916699:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788744966.916705:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788744966.916824:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744966.916887:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.916990:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744966.917097:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419903744 00000100:00100000:0.0:1788744966.917105:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419903744 00000100:00100000:0.0:1788744966.917193:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744966.917202:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419903744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744966.917618:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419903744:12345-0@lo:501:mount.lustre.0 Request processed in 415us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744966.917626:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744966.917738:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744966.917790:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744966.917856:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.917889:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744966.918400:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419903872 00000100:00100000:3.0:1788744966.918406:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419903872 00000100:00100000:3.0:1788744966.918490:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744966.918498:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419903872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744966.922841:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419903872:12345-0@lo:503:mount.lustre.0 Request processed in 4334us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744966.922859:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788744966.922992:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419903872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788744966.923504:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744966.923580:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419904000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744966.923632:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.923674:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744966.923680:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419904000 00000100:00100000:0.0:1788744966.923692:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419904000 00000100:00100000:0.0:1788744966.923802:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744966.923813:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419904000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744966.924660:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419904000:12345-0@lo:502:mount.lustre.0 Request processed in 848us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744966.924668:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788744966.924736:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419904000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744966.924923:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788744966.924950:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788744966.924968:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788744966.924982:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788744966.924993:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788744966.925017:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788744966.925031:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788744966.925043:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788744966.925054:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788744966.925067:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788744966.925080:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788744966.925094:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788744966.925107:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788744966.925118:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788744966.925195:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788744966.925214:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788744966.925228:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788744966.925241:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788744966.925295:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788744966.925312:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788744966.925326:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788744966.925340:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788744966.925356:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788744966.925481:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788744966.925499:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788744966.925514:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788744966.925525:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788744966.925537:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788744966.925549:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788744966.925564:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788744966.925578:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788744966.925591:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788744966.925604:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788744966.925617:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788744966.925646:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788744966.925662:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788744966.925675:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788744966.925688:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788744966.925711:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788744966.925725:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788744966.925738:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788744966.925751:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788744966.925764:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788744966.925776:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788744966.925871:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419904128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744966.925932:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744966.926029:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744966.926070:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419904128 00000100:00100000:3.0:1788744966.926077:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419904128 00000100:00100000:1.0:1788744966.926229:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744966.926240:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419904128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744966.926563:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419904128:12345-0@lo:502:mount.lustre.0 Request processed in 323us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744966.926571:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744966.927745:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419904128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744966.927859:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788744966.927872:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788744966.928822:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744966.928835:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744966.928838:0:23487:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788744966.928843:0:23487:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788744966.928846:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744966.928862:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9ce3c18e8000) 00000020:00000080:0.0:1788744966.928883:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788744966.928890:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788744966.928984:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744966.928991:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6e465a23bbc29d48 00000020:00000080:0.0:1788744966.929657:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788744966.929664:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744966.929669:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744966.929671:0:23487:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788744966.929675:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744966.929679:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744966.929680:0:23487:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788744966.929684:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744966.929694:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ce3c18ecd40) 00000020:00000080:0.0:1788744966.929706:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788744966.929712:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788744966.929713:0:23487:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788744966.929716:0:23487:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788744966.929722:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788744966.929798:0:23487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce3bda7d000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788744966.929812:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ce3c18eb380) 00000020:00000080:0.0:1788744966.929827:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788744966.929883:0:23487:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788744966.929889:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6e465a23bbc29d5d 00000020:00000080:0.0:1788744966.929973:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788744966.929980:0:23487:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788744966.929984:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6e465a23bbc29d64 00080000:01000000:0.0:1788744966.929990:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788744966.929993:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6e465a23bbc29d6b 00010000:00010000:0.0:1788744967.005528:0:23487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788744967.006086:0:23487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1788744967.006702:0:23487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788744967.007794:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788744967.007808:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744967.007815:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.007817:0:23487:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788744967.007821:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744967.007827:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.007828:0:23487:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788744967.007831:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788744967.007843:0:23487:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:00000080:3.0:1788744967.007918:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744967.007935:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ce388af8000) 00000020:00000080:3.0:1788744967.008070:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788744967.008078:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788744967.008135:0:23487:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788744967.008140:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788744967.008145:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6e465a23bbc29d79 00010000:00080000:3.0:1788744967.008170:0:23487:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce3945f7000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1788744967.010925:0:23487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788744967.012083:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788744967.012096:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788744967.012134:0:23487:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788744967.012156:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6e465a23bbc29d80 00000100:00080000:1.0:1788744967.012169:0:23487:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744967.012182:0:23487:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ce3945f7000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788744967.012220:0:23487:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce2882f7100 x1875634419904256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744967.012241:0:23487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788744967.012519:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744967.012524:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744967.012526:0:23487:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788744967.012530:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788744967.012534:0:23487:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788744967.012536:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744967.012537:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744967.012540:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788744967.012542:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744967.012549:0:23487:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788744967.012564:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744967.012570:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744967.012571:0:23487:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788744967.012575:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788744967.012610:0:23487:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788744967.012623:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744967.012625:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744967.012627:0:23487:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788744967.012629:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788744967.012631:0:23487:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788744967.012632:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744967.012634:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744967.012636:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788744967.012638:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744967.012640:0:23487:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788744967.012642:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744967.012646:0:23487:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788744967.012649:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744967.012650:0:23487:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788744967.012653:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744967.012656:0:23487:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:1.0:1788744967.012681:0:23487:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788744967.012683:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744967.012697:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ce3bd044d40) 00000020:00000080:1.0:1788744967.012709:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788744967.012715:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744967.012778:0:23487:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788744967.012796:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788744967.012802:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6e465a23bbc29d8e 00010000:00080000:1.0:1788744967.012842:0:23487:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce3a0c1b000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.146@tcp at head 00000100:00080000:2.0:1788744967.012984:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.012990:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744967.012993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.012996:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788744967.013054:0:23487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788744967.013608:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419904256:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744967.013689:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744967.013757:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419904256 00000100:00100000:3.0:1788744967.013764:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419904256 00000100:00100000:3.0:1788744967.013809:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744967.013816:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419904256:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788744967.013847:0:22756:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:3.0:1788744967.013881:0:22756:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6e465a23bbc29d95 00000004:00100000:3.0:1788744967.013899:0:22756:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788744967.013905:0:22756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:1.0:1788744967.015066:0:23487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788744967.015515:0:23487:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788744967.019386:0:23487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788744967.019728:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9ce392429000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744967.019838:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1875634419904256:12345-0@lo:38:llog_process_th.0 Request processed in 6018us (6146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744967.019849:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744967.019908:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744967.019918:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788744967.019925:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788744967.019930:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788744967.019932:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744967.019952:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419904256:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744967.020084:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744967.020101:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419904384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744967.020137:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788744967.020171:0:23487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:0.0:1788744967.020174:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419904384 00000100:00100000:0.0:1788744967.020181:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419904384 00000040:00080000:3.0:1788744967.020420:0:23487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788744967.020470:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744967.020480:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1875634419904384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744967.020508:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788744967.020555:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1875634419904384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744967.020562:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744967.020595:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419904384:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788744967.020961:0:23492:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788744967.020966:0:23492:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788744967.021806:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744967.021819:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788744967.021866:0:23487:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788744967.021889:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6e465a23bbc29d9c 00000100:00080000:3.0:1788744967.021898:0:23487:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744967.021907:0:23487:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce3a0c1b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744967.021936:0:23487:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb2a00 x1875634419904512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744967.022069:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419904512:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788744967.022116:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419904512 offset 0 length 520: 4 00000100:00080000:3.0:1788744967.022170:0:23487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788744967.022237:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744967.022242:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.022279:0:23487:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788744967.022284:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788744967.022287:0:23487:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788744967.022289:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744967.022291:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744967.022292:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788744967.022295:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.022297:0:23487:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788744967.022299:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788744967.022303:0:23487:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788744967.022306:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.022308:0:23487:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788744967.022310:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788744967.022314:0:23487:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:3.0:1788744967.022333:0:23487:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788744967.022336:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744967.022348:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ce2879519c0) 00000020:00000080:3.0:1788744967.022373:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788744967.022379:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788744967.022453:0:23487:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788744967.022461:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788744967.022466:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6e465a23bbc29daa 00010000:00080000:3.0:1788744967.022511:0:23487:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce3945f5000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1788744967.022723:0:23487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788744967.022796:0:23487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788744967.022812:0:23487:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788744967.025574:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.025585:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744967.025588:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.025591:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788744967.029630:0:23487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744967.029840:0:23487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788744967.030029:0:23487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788744967.030750:0:23494:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788744967.030755:0:23494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788744967.031766:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788744967.031789:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788744967.031832:0:23487:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788744967.031857:0:23487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6e465a23bbc29db1 00000100:00080000:3.0:1788744967.031867:0:23487:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744967.031879:0:23487:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce3945f5000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744967.031916:0:23487:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb0e00 x1875634419904640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744967.032047:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419904640:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788744967.032109:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419904640 offset 0 length 520: 4 00000100:00080000:3.0:1788744967.032170:0:23487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788744967.032224:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744967.032229:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.032231:0:23487:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788744967.032234:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744967.032239:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.032240:0:23487:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744967.032278:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744967.032281:0:23487:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788744967.032284:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744967.032286:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.032288:0:23487:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788744967.032290:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744967.032292:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.032294:0:23487:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788744967.032297:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788744967.032323:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744967.032326:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744967.032332:0:23487:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788744967.032336:0:23487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1788744967.032732:0:23483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788744967.032760:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788744967.032792:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d3a expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.032815:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3600/0x6e465a23bbc29d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29d3a expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744967.032824:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3bda7d000 from 1 10000000:01000000:2.0:1788744967.032827:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744967.032856:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.032864:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.032877:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744967.032895:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419904768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744967.032936:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.033114:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a01d80 going to sleep for 11 seconds 00000100:00080000:2.0:1788744967.033134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.033139:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744967.033142:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.033145:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788744967.033631:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419904768 00000100:00100000:0.0:1788744967.033638:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419904768 00000100:00100000:0.0:1788744967.033757:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744967.033766:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+15:23483:x1875634419904768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744967.033789:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744967.033803:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29db8 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744967.033828:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 16 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744967.033840:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 16 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744967.033848:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf6c00, rc 0) 00000100:00100000:0.0:1788744967.033904:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:23483:x1875634419904768:12345-0@lo:101:mount.lustre.0 Request processed in 139us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744967.033911:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788744967.033987:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419904768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744967.034003:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.034012:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744967.034584:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419904896:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788744967.034624:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.035455:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a01d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744967.035825:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419904896 00000100:00100000:1.0:1788744967.035833:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419904896 00000100:00100000:1.0:1788744967.035876:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744967.035885:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:23483:x1875634419904896:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788744967.035911:0:22742:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788744967.035934:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788744967.036010:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788744967.036121:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:23483:x1875634419904896:12345-0@lo:256:mount.lustre.0 Request processed in 237us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744967.036130:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744967.036227:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419904896:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788744967.037219:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788744967.037240:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.037627:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744967.037636:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce3bda7d000 from 1 10000000:01000000:2.0:1788744967.037639:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744967.037675:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.037684:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.037694:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744967.037718:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744967.037769:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.037856:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a01d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.037980:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419905024 00000100:00100000:3.0:1788744967.037988:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419905024 00000100:00100000:1.0:1788744967.038105:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744967.038117:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:23483:x1875634419905024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744967.038131:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744967.038152:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29dc6 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.038176:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 17 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.038186:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 17 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.038194:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3c21c8800, rc 0) 00000100:00100000:1.0:1788744967.038315:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905024:12345-0@lo:101:mount.lustre.0 Request processed in 200us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744967.038322:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744967.038735:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744967.038761:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.038771:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744967.040816:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788744967.041203:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744967.041880:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788744967.041910:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788744967.041925:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788744967.042019:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788744967.042040:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788744967.042055:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788744967.042068:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788744967.042081:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788744967.042092:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788744967.042104:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788744967.042118:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788744967.042159:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788744967.042165:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788744967.042486:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744967.042632:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744967.042728:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afa38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744967.042774:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419905152 00000100:00100000:1.0:1788744967.042790:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419905152 00000100:00100000:1.0:1788744967.042870:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788744967.042880:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744967.043016:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905152:12345-0@lo:501:mount.lustre.0 Request processed in 136us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744967.043024:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744967.043097:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744967.043129:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905280:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744967.043166:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744967.043589:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afa38e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.043709:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419905280 00000100:00100000:3.0:1788744967.043715:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419905280 00000100:00100000:3.0:1788744967.043741:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788744967.043748:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744967.043850:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905280:12345-0@lo:503:mount.lustre.0 Request processed in 102us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.043858:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744967.044000:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905280:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788744967.044551:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744967.044697:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744967.044748:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744967.044770:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afa38e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.044858:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419905408 00000100:00100000:3.0:1788744967.044864:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419905408 00000100:00100000:3.0:1788744967.044891:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744967.044900:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744967.045080:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905408:12345-0@lo:502:mount.lustre.0 Request processed in 181us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.045088:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788744967.045166:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744967.045547:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788744967.045735:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788744967.045750:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788744967.045763:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788744967.045789:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788744967.045804:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788744967.045817:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788744967.045830:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788744967.045844:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788744967.045856:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788744967.045869:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788744967.045906:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744967.046155:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744967.046223:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afa38e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.046465:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419905536 00000100:00100000:3.0:1788744967.046472:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419905536 00000100:00100000:3.0:1788744967.046548:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744967.046567:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744967.046673:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905536:12345-0@lo:502:mount.lustre.0 Request processed in 107us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.046680:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744967.046768:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744967.046835:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788744967.046846:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788744967.048145:0:23496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744967.048156:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744967.048159:0:23496:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788744967.048166:0:23496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce3bda7d000 00000020:00000080:2.0:1788744967.048169:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744967.048178:0:23496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744967.048181:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744967.048182:0:23496:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788744967.048185:0:23496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744967.048187:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744967.048188:0:23496:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788744967.048191:0:23496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce3bda7d000 00000020:00000080:2.0:1788744967.048193:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744967.050396:0:23496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744967.050410:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744967.050413:0:23496:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788744967.050417:0:23496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744967.050422:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744967.050423:0:23496:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744967.050430:0:23496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce3bda7d000 00000020:00000080:2.0:1788744967.050439:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744967.050488:0:23496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744967.050491:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744967.050493:0:23496:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744967.050495:0:23496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744967.050498:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744967.050499:0:23496:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788744967.050503:0:23496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce3bda7d000 00000020:00000080:2.0:1788744967.050505:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744967.050545:0:23496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744967.050548:0:23496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744967.050550:0:23496:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788744967.051015:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788744967.051103:0:23483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788744967.051130:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744967.051157:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.051171:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744967.051227:0:23483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788744967.051231:0:23483:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce3bda7d000 10000000:01000000:2.0:1788744967.051234:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce3bda7d000 10000000:01000000:2.0:1788744967.051238:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744967.051264:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ce3bda7d000 from 1 10000000:01000000:2.0:1788744967.051268:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744967.051315:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2600/0x6e465a23bbc29dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.051324:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2600/0x6e465a23bbc29dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.051346:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2600/0x6e465a23bbc29dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744967.051484:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744967.051626:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744967.054179:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419905664 00000100:00100000:1.0:1788744967.054194:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419905664 00000100:00100000:1.0:1788744967.056164:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788744967.056176:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:23483:x1875634419905664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744967.056195:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744967.056214:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3c21c8e00/0x6e465a23bbc29ddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29dd4 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.056262:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3c21c8e00/0x6e465a23bbc29ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29dd4 expref: 18 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.056439:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3c21c8e00/0x6e465a23bbc29ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29dd4 expref: 18 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.056448:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3c21c8e00, rc 0) 00000100:00100000:1.0:1788744967.056516:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419905664:12345-0@lo:101:mount.lustre.0 Request processed in 343us (4891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744967.056523:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788744967.060477:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a01480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744967.060518:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744967.060545:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2600/0x6e465a23bbc29dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ddb expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.060676:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2600/0x6e465a23bbc29dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29ddb expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744967.064525:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788744967.066684:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744967.068453:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788744967.068502:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788744967.068518:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788744967.068530:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788744967.068544:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788744967.069030:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788744967.069051:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788744967.069065:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788744967.069079:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788744967.069093:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788744967.069107:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788744967.069121:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788744967.069135:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788744967.069172:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788744967.069188:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788744967.069200:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788744967.069213:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788744967.069228:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788744967.069241:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788744967.070472:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788744967.070500:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788744967.070514:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788744967.070526:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788744967.070539:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788744967.071355:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788744967.071455:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788744967.071471:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788744967.071485:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788744967.071500:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788744967.071531:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788744967.071547:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788744967.072031:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788744967.072050:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788744967.072063:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788744967.072076:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788744967.072089:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788744967.072102:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788744967.072115:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788744967.072128:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788744967.072142:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788744967.072156:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788744967.072169:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788744967.072183:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788744967.072197:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788744967.072209:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788744967.072236:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788744967.073037:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788744967.073056:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788744967.073212:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788744967.073232:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788744967.074521:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788744967.074540:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788744967.075931:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744967.076086:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.076139:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744967.076176:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419905792 00000100:00100000:2.0:1788744967.076184:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419905792 00000100:00100000:2.0:1788744967.076823:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788744967.076838:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419905792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744967.076999:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419905792:12345-0@lo:501:mount.lustre.0 Request processed in 165us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744967.092125:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788744967.092239:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744967.092690:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744967.092762:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.092819:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.093066:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419905920 00000100:00100000:3.0:1788744967.093073:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419905920 00000100:00100000:3.0:1788744967.093121:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788744967.093136:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419905920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744967.093666:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419905920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744967.094171:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419905920:12345-0@lo:503:mount.lustre.0 Request processed in 1035us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.094181:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:2.0:1788744967.095764:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744967.095890:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419906048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744967.096008:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.096066:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a01480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.100399:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419906048 00000100:00100000:3.0:1788744967.100415:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419906048 00000100:00100000:3.0:1788744967.100472:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744967.100483:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419906048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744967.100673:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419906048:12345-0@lo:502:mount.lustre.0 Request processed in 192us (4665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.100681:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744967.101049:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419906048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744967.101645:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788744967.101676:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788744967.101685:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788744967.101692:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788744967.101699:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788744967.101718:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788744967.101726:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788744967.101732:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788744967.101739:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788744967.101745:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788744967.101752:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788744967.101759:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788744967.101765:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788744967.101772:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788744967.101792:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788744967.101807:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788744967.101824:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788744967.101837:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788744967.101850:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788744967.101862:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788744967.101876:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788744967.101901:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788744967.101916:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788744967.101925:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788744967.101933:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788744967.102752:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788744967.102765:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788744967.102772:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788744967.102790:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788744967.102800:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788744967.102807:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788744967.102814:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788744967.102830:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788744967.102837:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788744967.102844:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788744967.102850:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788744967.102857:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788744967.102873:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788744967.102882:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788744967.102888:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788744967.102895:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788744967.102902:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788744967.102910:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788744967.102917:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788744967.102923:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788744967.102931:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788744967.103345:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788744967.103528:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788744967.103849:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419906176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744967.103946:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.104167:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a01480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.105863:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419906176 00000100:00100000:3.0:1788744967.105878:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419906176 00000100:00100000:3.0:1788744967.105955:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788744967.105973:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419906176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744967.106648:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419906176:12345-0@lo:502:mount.lustre.0 Request processed in 683us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.106657:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788744967.106904:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419906176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744967.107471:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788744967.107498:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788744967.107527:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419906304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744967.107570:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.107613:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a01480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744967.107631:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419906304 00000100:00100000:0.0:1788744967.107638:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419906304 00000100:00100000:0.0:1788744967.107681:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744967.107690:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419906304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744967.107799:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419906304:12345-0@lo:502:mount.lustre.0 Request processed in 110us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744967.107805:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744967.107879:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419906304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744967.107920:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788744967.107930:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788744967.108875:0:23503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788744967.108890:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ce3bd0419c0) 00000020:00000080:1.0:1788744967.108910:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788744967.109073:0:23503:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce3bda7d000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788744967.109078:0:23503:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce3bda7d000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788744967.109081:0:23503:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3bda7d000 3 00010000:00080000:1.0:1788744967.109109:0:23503:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce3bf8f4800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.146@tcp at head 00010000:00010000:0.0:1788744967.114182:0:23503:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788744967.115155:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788744967.115210:0:23503:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788744967.115403:0:23503:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6e465a23bbc29de9 00000100:00080000:0.0:1788744967.115416:0:23503:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744967.115428:0:23503:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ce3bf8f4800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1788744967.115467:0:23503:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bcf7e680 x1875634419906432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744967.115497:0:23503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788744967.115742:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875634419906432:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788744967.115812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744967.115818:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788744967.115821:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788744967.115822:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788744967.115825:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:2.0:1788744967.115834:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788744967.115839:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce3c18fc000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744967.115855:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c1880 x1875634419906560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744967.115865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.115868:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744967.115871:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.115874:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788744967.115879:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419906560:0@lo:38:kworker.0 00000100:00100000:3.0:1788744967.115903:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788744967.115905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.115909:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744967.115911:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744967.115914:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788744967.115928:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419906688:0@lo:400:kworker.0 00000100:00100000:2.0:1788744967.115930:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744967.116009:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419906816:0@lo:400:kworker.0 00000100:00100000:2.0:1788744967.116043:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.116077:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419906560 00000100:00100000:2.0:1788744967.116084:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419906560 00000100:00100000:2.0:1788744967.116117:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419906816 00000100:00100000:2.0:1788744967.116120:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419906816 00000100:00100000:3.0:1788744967.116515:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.116542:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744967.116550:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419906560:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788744967.116564:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419906432 00000100:00100000:3.0:1788744967.116574:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419906432 00000100:00100000:3.0:1788744967.116593:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419906688 00000100:00100000:3.0:1788744967.116595:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419906688 00000100:00100000:2.0:1788744967.116605:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1875634419906560:12345-0@lo:38:kworker.0 Request processed in 55us (701us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788744967.116612:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744967.116613:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744967.116618:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419906688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744967.116631:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744967.116636:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1875634419906816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744967.116657:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419906688:12345-0@lo:400:kworker.0 Request processed in 38us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.116663:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744967.116663:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1875634419906816:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744967.116668:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744967.116677:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744967.116681:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419906432:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788744967.116696:0:22750:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000100:00100000:2.0:1788744967.116698:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419906816:0@lo:400:kworker.0 00000020:00000080:3.0:1788744967.116728:0:22750:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6e465a23bbc29df0 00000004:00100000:3.0:1788744967.116744:0:22750:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788744967.116773:0:22750:0:(import.c:65:import_set_state_nolock()) ffff9ce3af9b7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744967.116821:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875634419906432:12345-0@lo:38:llog_process_th.0 Request processed in 138us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.116827:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1788744967.116829:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00010000:00080000:3.0:1788744967.116858:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce3bd4c1500 x1875634419906688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744967.116869:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419906688:0@lo:400:kworker.0 00000100:00100000:3.0:1788744967.116887:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788744967.116893:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000020:01000000:2.0:1788744967.116894:0:23483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00080000:3.0:1788744967.116897:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788744967.116899:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419906560:0@lo:38:kworker.0 00010000:00080000:3.0:1788744967.116908:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce3bcf7e680 x1875634419906432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744967.116925:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 10000000:01000000:2.0:1788744967.116927:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:3.0:1788744967.116930:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788744967.116950:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788744967.116956:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788744967.116958:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3bf8f4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788744967.116971:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875634419906432:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1788744967.117048:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2600/0x6e465a23bbc29dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ddb expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.117060:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2600/0x6e465a23bbc29dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ddb expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744967.117103:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744967.117105:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744967.117106:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744967.117107:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744967.117108:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744967.117110:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744967.117111:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744967.117114:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744967.117116:0:23483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744967.117119:0:23483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788744967.117122:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744967.117124:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744967.117125:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744967.117126:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744967.117127:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744967.117128:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744967.117129:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744967.117130:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744967.117135:0:23483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744967.117152:0:23483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788744967.117166:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419906944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744967.117201:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744967.117233:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.117501:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419906944 00000100:00100000:3.0:1788744967.117507:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419906944 00000100:00100000:3.0:1788744967.117541:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744967.117645:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419906944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788744967.117673:0:22744:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788744967.117690:0:22744:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788744967.120915:0:22730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788744967.121289:0:22744:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744967.121302:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788744967.121315:0:22766:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744967.121320:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744967.121341:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744967.121359:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744967.121367:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744967.121374:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744967.121420:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744967.121432:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 18 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744967.121447:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419907072:0@lo:104: 00000100:00100000:0.0:1788744967.121512:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744967.121570:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744967.121577:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419907072 00010000:00010000:0.0:1788744967.121578:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 18 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744967.121584:0:22733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419907072 00000100:00100000:0.0:1788744967.121586:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419907200:0@lo:104: 00000100:00100000:0.0:1788744967.121605:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744967.121630:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3895b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744967.123160:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419907200 00000100:00100000:1.0:1788744967.123171:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419907200 00000100:00100000:1.0:1788744967.123210:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744967.123220:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:22766:x1875634419907072:12345-0@lo:104: 00010000:00010000:1.0:1788744967.123236:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123625:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744967.123631:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:22766:x1875634419907072:12345-0@lo:104: Request processed in 413us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744967.123647:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744967.123667:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744967.123673:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:22766:x1875634419907200:12345-0@lo:104: 00010000:00010000:1.0:1788744967.123681:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123713:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744967.123719:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:22766:x1875634419907200:12345-0@lo:104: Request processed in 46us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744967.123724:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788744967.123738:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744967.123745:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123752:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f2e00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744967.123756:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123765:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744967.123770:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744967.123774:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744967.123818:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123824:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744967.123850:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123858:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2e00/0x6e465a23bbc29db8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29dbf expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123870:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744967.123874:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123880:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce381491000 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744967.123883:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.123889:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744967.123895:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744967.123905:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744967.123928:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744967.123955:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:23483:x1875634419906944:12345-0@lo:253:mount.lustre.0 Request processed in 6406us (6751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744967.124065:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:23483:1875634419906944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744967.124077:0:23483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788744967.124081:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744967.124082:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788744967.124084:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744967.124085:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744967.124086:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744967.124088:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744967.124089:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744967.124091:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744967.124092:0:23483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788744967.124108:0:23483:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788744967.124124:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744967.124139:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419907328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744967.124174:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744967.124230:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419907328 00000100:00100000:3.0:1788744967.124235:0:22736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419907328 00010000:00010000:3.0:1788744967.124361:0:22736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 19 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744967.124383:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744967.124391:0:22736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:3636:x1875634419907328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744967.124401:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744967.124412:0:22736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 19 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.124423:0:22736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 19 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.124439:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744967.124467:0:22736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:3636:x1875634419907328:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.124474:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744967.124513:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419907328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744967.124537:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29dbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29db8 expref: 18 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744967.124547:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419907072:0@lo:104: 00000100:00100000:3.0:1788744967.124556:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419907200:0@lo:104: 00010000:00010000:3.0:1788744967.124570:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.124624:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788744967.124661:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419907456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744967.124686:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744967.124730:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.124736:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce381491000/0x6e465a23bbc29cf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cfb expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744967.124759:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744967.124761:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744967.124762:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744967.124769:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744967.125066:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744967.125139:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419907456 00000100:00100000:3.0:1788744967.125144:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419907456 00010000:00010000:3.0:1788744967.125160:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 17 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744967.125180:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744967.125188:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:3634:x1875634419907456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744967.125202:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744967.125207:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 17 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125215:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 17 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125227:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3a6bf7000/0x6e465a23bbc29cfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29cf4 expref: 17 pid: 22744 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125237:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125617:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744967.125635:0:22737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006566327s 00010000:00010000:3.0:1788744967.125640:0:22737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125648:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125654:0:22737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125660:0:22737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125666:0:22737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf6a00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788744967.125670:0:22737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.125684:0:22737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.126441:0:22737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744967.126456:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744967.126472:0:22766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.126480:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744967.126485:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc29df7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744967.126513:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:3634:x1875634419907456:12345-0@lo:103:ldlm_bl.0 Request processed in 1326us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.126521:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744967.126586:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419907456:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788744967.128070:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788744967.128089:0:23508:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788744967.128094:0:23508:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788744967.128636:0:23509:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788744967.129051:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744967.131145:0:23509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788744967.131596:0:23509:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788744967.131761:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788744967.132588:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875634419907584:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788744967.132649:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744967.132682:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3bd5d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744967.132686:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419907584 00000100:00100000:3.0:1788744967.132694:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419907584 00000100:00100000:3.0:1788744967.132796:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744967.132806:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23510:x1875634419907584:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788744967.132853:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1788744967.132885:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23510:x1875634419907584:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744967.132892:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:2.0:1788744967.132892:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744967.133318:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875634419907584:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788744967.133347:0:23510:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788744967.133379:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875634419907712:0@lo:1000:lod0001_rec0000.0 00000004:00000080:2.0:1788744967.133684:0:23483:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788744967.133693:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788744967.133746:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744967.133770:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744967.133832:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b40389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744967.134119:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419907712 00000100:00100000:1.0:1788744967.134125:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419907712 00000100:00100000:1.0:1788744967.134188:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744967.134195:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23510:x1875634419907712:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788744967.134352:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23510:x1875634419907712:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 157us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744967.134360:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744967.134540:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875634419907712:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788744967.134667:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23510:1875634419907840:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788744967.134693:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744967.134714:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b40383c0 going to sleep for 11 seconds 00000040:00080000:2.0:1788744967.135175:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788744967.135235:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419907840 00000100:00100000:2.0:1788744967.135241:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419907840 00000100:00100000:2.0:1788744967.135507:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744967.135514:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23510:x1875634419907840:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788744967.135609:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23510:x1875634419907840:12345-0@lo:900:lod0001_rec0000.0 Request processed in 95us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744967.135617:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788744967.135921:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00080000:0.0:1788744967.136114:0:23510:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ce3a6bb1f80 x1875634419907840/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788744983 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744967.136128:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23510:1875634419907840:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788744967.136201:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7d500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875634419907968:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788744967.136234:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744967.136272:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afa013c0 going to sleep for 11 seconds 00000040:01000000:3.0:1788744967.137364:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:2.0:1788744967.137669:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419907968 00000100:00100000:2.0:1788744967.137679:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419907968 00000100:00100000:2.0:1788744967.137732:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744967.137742:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23510:x1875634419907968:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788744967.137860:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23510:x1875634419907968:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744967.137868:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744967.137910:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7d500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875634419907968:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788744967.137923:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744967.138174:0:23510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788744967.139535:0:23483:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:2.0:1788744967.142822:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788744967.142907:0:23510:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788744967.142912:0:23510:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1788744967.143102:0:23483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788744967.155830:0:23483:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788744967.155879:0:23483:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffab0840dab988 00100000:10000000:1.0:1788744967.155887:0:23483:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788744967.157000:0:23483:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788744967.157039:0:23483:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.146@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788744967.157057:0:23483:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788744967.157083:0:23483:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788744967.161193:0:23483:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744967.165979:0:23483:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744967.188679:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744967.632512:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000040:00080000:2.0:1788744968.146211:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788744968.209004:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788744968.348774:0:22747:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788744968.348784:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3bda7d000 from 12 10000000:01000000:1.0:1788744968.348790:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744968.348837:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.348863:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.348876:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744968.348905:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419908096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744968.348988:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744968.349038:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744968.349063:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419908096 00000100:00100000:1.0:1788744968.349071:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419908096 00000100:00100000:1.0:1788744968.349123:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788744968.349133:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:22747:x1875634419908096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744968.349150:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744968.349164:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29dfe expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.349189:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.349199:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.349208:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3c21c9800, rc 0) 00000100:00100000:1.0:1788744968.349271:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419908096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744968.349278:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788744968.349334:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419908096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744968.349350:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.349359:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744968.349406:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419908224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788744968.349435:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744968.349453:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a0d57cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744968.349578:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419908224 00000100:00100000:0.0:1788744968.349583:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419908224 00000100:00100000:0.0:1788744968.349618:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744968.349625:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419908224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788744968.349638:0:22742:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744968.349655:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744968.349658:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788744968.349736:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419908224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744968.349743:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744968.349786:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419908224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788744968.349832:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744968.349839:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744968.349848:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744968.349857:0:22747:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744968.349860:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3ba964000 from 12 10000000:01000000:0.0:1788744968.349862:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744968.349880:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744968.349893:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744968.349902:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744968.349916:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419908352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744968.351842:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744968.351889:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afa01780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744968.352068:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419908352 00000100:00100000:1.0:1788744968.352077:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419908352 00000100:00100000:1.0:1788744968.352130:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788744968.352139:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419908352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744968.352157:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744968.352173:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29e0c expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.352200:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 18 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.352212:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 18 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744968.352221:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3c21c8600, rc 0) 00000100:00100000:1.0:1788744968.352301:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:22747:x1875634419908352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744968.352307:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744968.352698:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419908352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744968.352715:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744968.352725:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744968.352803:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419908480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744968.352841:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744968.352871:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afa01780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744968.352884:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419908480 00000100:00100000:0.0:1788744968.352888:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419908480 00000100:00100000:0.0:1788744968.352913:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744968.352920:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:22747:x1875634419908480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788744968.352935:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744968.358116:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744968.358125:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788744968.358299:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:22747:x1875634419908480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 5374us (5452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744968.358311:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744968.358404:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419908480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788744968.358479:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744968.358490:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744968.358503:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744968.657312:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000040:00080000:3.0:1788744969.176205:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744969.247708:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744969.680751:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00010000:00010000:3.0:1788744970.257207:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744970.707863:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00010000:00010000:0.0:1788744971.283443:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744971.732237:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 0 seconds 00000001:02000400:1.0:1788744972.196557:0:23752:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788744972.305062:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744972.369381:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744972.369390:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788744972.369394:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744972.369413:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ce3c18fc000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744972.369438:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c3800 x1875634419908736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744972.369468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744972.369472:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744972.369475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744972.369478:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744972.369504:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744972.369508:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744972.369510:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744972.369513:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744972.369562:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419909120:0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.369634:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744972.369672:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744972.369679:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419908608:0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.369729:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744972.369771:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419908736:0@lo:38:kworker.0 00000100:00100000:2.0:1788744972.369798:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744972.369829:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875634419908864:0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.369851:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744972.369870:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744972.369875:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419908992:0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.369895:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744972.369931:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419909120 00000100:00100000:2.0:1788744972.369939:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419909120 00000100:00100000:2.0:1788744972.369982:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419908864 00000100:00100000:2.0:1788744972.369985:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419908864 00000100:00100000:2.0:1788744972.369998:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744972.370005:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419909120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.370051:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419909120:12345-0@lo:400:kworker.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744972.370058:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744972.370073:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744972.370078:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875634419908864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.370101:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875634419908864:12345-0@lo:400:kworker.0 Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744972.370106:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744972.370121:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419908608 00000100:00100000:2.0:1788744972.370124:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419908608 00000100:00100000:2.0:1788744972.370159:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788744972.370165:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:3634:x1875634419908608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.370190:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:3634:x1875634419908608:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744972.370196:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788744972.370218:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419908736 00000100:00100000:2.0:1788744972.370221:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419908736 00000100:00100000:2.0:1788744972.370229:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419908992 00000100:00100000:2.0:1788744972.370230:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419908992 00000100:00100000:2.0:1788744972.370242:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744972.370265:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1875634419908736:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788744972.370286:0:22755:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:2.0:1788744972.370324:0:22755:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6e465a23bbc29e1a 00000004:00100000:2.0:1788744972.370344:0:22755:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788744972.370349:0:22755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:2.0:1788744972.370457:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3bd4c1c00 x1875634419908864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744972.370473:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875634419908864:0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.370497:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419908608:0@lo:400:kworker.0 00010000:00080000:2.0:1788744972.370505:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3bd4c0380 x1875634419909120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744972.370513:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419909120:0@lo:400:kworker.0 00000100:00100000:2.0:1788744972.372956:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744972.372987:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419909248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744972.373085:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744972.375437:0:22756:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788744972.375458:0:22756:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788744972.375679:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419909248 00000100:00100000:2.0:1788744972.375697:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419909248 00000100:00100000:3.0:1788744972.376115:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744972.376206:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1875634419908992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744972.378332:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1875634419908992:12345-0@lo:400:kworker.0 Request processed in 2197us (8425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744972.378345:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744972.378381:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744972.378392:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419909248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788744972.378430:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788744972.378464:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419909248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (5380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744972.378470:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744972.379498:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419908992:0@lo:400:kworker.0 00000100:00080000:3.0:1788744972.380348:0:22755:0:(import.c:65:import_set_state_nolock()) ffff9ce3bf88d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744972.380430:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875634419908736:12345-0@lo:38:kworker.0 Request processed in 10163us (10630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744972.380440:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744972.380551:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419909248:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788744972.380638:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788744972.380649:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788744972.380654:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788744972.380657:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3c18fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788744972.380681:0:3633:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000522ebc95): req@ffff9ce3bd4c0a80 x1875634419901312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744972.380714:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419908736:0@lo:38:kworker.0 00000100:00100000:1.0:1788744972.380815:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744972.380847:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b4044c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744972.380960:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419909376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744972.380986:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744972.381043:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419901312 00000100:00100000:3.0:1788744972.381050:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419901312 00000100:00100000:3.0:1788744972.381091:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419909376 00000100:00100000:3.0:1788744972.381094:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419909376 00000100:00100000:3.0:1788744972.381109:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744972.381117:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22792:x1875634419901312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788744972.381293:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22792:x1875634419901312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 175us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744972.381300:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744972.381314:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744972.381320:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875634419909376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788744972.381341:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788744972.381372:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875634419909376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744972.381378:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744972.381458:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875634419901312:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788744972.381498:0:22792:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788744972.381534:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875634419909504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788744972.381566:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744972.381588:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b40449c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744972.381603:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419909504 00000100:00100000:1.0:1788744972.381607:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419909504 00000100:00100000:1.0:1788744972.381627:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744972.381633:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22792:x1875634419909504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788744972.381745:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22792:x1875634419909504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744972.381752:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744972.381784:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419909376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744972.381807:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875634419909504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788744972.381869:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875634419909632:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788744972.381892:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744972.381921:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce287760480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744972.381935:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419909632 00000100:00100000:1.0:1788744972.381938:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419909632 00000100:00100000:1.0:1788744972.381955:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744972.381961:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22792:x1875634419909632:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788744972.382006:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22792:x1875634419909632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744972.382013:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744972.382037:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875634419909632:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788744972.382078:0:22792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744972.387588:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788744972.387674:0:22792:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:1.0:1788744972.387679:0:22792:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788744973.118873:0:23807:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744973.119086:0:23807:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744973.328803:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744973.782477:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788744974.050355:0:23857:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744974.050559:0:23857:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788744974.352559:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744975.082867:0:23906:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7e42fa80 20000000:00000080:2.0:1788744975.082885:0:23906:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce3be983c00 uarg=0000000000000000 20000000:01000000:2.0:1788744975.082928:0:23906:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788744975.082936:0:23906:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788744975.082941:0:23906:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788744975.083776:0:23907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788744975.083940:0:23906:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788744975.092348:0:23906:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788744975.092483:0:23906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.092502:0:23906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.092524:0:23906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 17 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.092532:0:23906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.092574:0:23906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 17 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.092589:0:23906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 17 pid: 22742 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744975.092603:0:23906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23906:1875634419909760:0@lo:104: 00000100:00100000:2.0:1788744975.092678:0:23906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744975.092789:0:23906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.092798:0:23906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 17 pid: 22745 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744975.092806:0:23906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23906:1875634419909888:0@lo:104: 00000100:00100000:2.0:1788744975.092828:0:23906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744975.092893:0:23906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a6945840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744975.092955:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419909760 00000100:00100000:1.0:1788744975.092964:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419909760 00000100:00100000:1.0:1788744975.093001:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419909888 00000100:00100000:1.0:1788744975.093004:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419909888 00000100:00100000:1.0:1788744975.093018:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744975.093026:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:23906:x1875634419909760:12345-0@lo:104: 00010000:00010000:1.0:1788744975.093036:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093104:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744975.093110:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:23906:x1875634419909760:12345-0@lo:104: Request processed in 86us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744975.093116:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744975.093135:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744975.093141:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:23906:x1875634419909888:12345-0@lo:104: 00010000:00010000:1.0:1788744975.093157:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093192:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744975.093196:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:23906:x1875634419909888:12345-0@lo:104: Request processed in 56us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744975.093202:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788744975.093230:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744975.093235:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093265:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f3400 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744975.093270:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093279:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744975.093288:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744975.093293:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744975.093321:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093327:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744975.093346:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093353:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3400/0x6e465a23bbc29dc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29dcd expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093371:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744975.093374:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093380:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3c21c8400 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788744975.093383:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093389:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744975.093395:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744975.093400:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744975.093413:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093419:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744975.093434:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093440:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c8400/0x6e465a23bbc29cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29cca expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093454:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744975.093456:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744975.093458:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744975.093477:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419910016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744975.093511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744975.093546:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419910144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744975.093571:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744975.093603:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419910016 00000100:00100000:1.0:1788744975.093607:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419910016 00010000:00010000:1.0:1788744975.093625:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 18 pid: 22742 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744975.093655:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419910144 00000100:00100000:1.0:1788744975.093658:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419910144 00010000:00010000:1.0:1788744975.093669:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 19 pid: 22745 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744975.093681:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744975.093687:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:3637:x1875634419910016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744975.093697:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744975.093702:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 19 pid: 22742 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093712:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 19 pid: 22742 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093728:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744975.093756:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:3637:x1875634419910016:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744975.093762:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744975.093776:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744975.093781:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:3634:x1875634419910144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744975.093792:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744975.093803:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 18 pid: 22745 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093811:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 18 pid: 22745 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093822:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093829:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093840:0:22737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093847:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093853:0:22737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093859:0:22737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093863:0:22737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f2e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:1.0:1788744975.093867:0:22737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093873:0:22737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093880:0:22737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.093897:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744975.093926:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:3634:x1875634419910144:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744975.093932:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744975.093968:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419910144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744975.093990:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419910016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744975.094120:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744975.094499:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3c21c8800/0x6e465a23bbc29dcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29dc6 expref: 17 pid: 22742 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744975.094510:0:23906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23906:1875634419909760:0@lo:104: 00010000:00010000:2.0:1788744975.094521:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc29cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29cc3 expref: 16 pid: 22745 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744975.094540:0:23906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23906:1875634419909888:0@lo:104: 00010000:00010000:2.0:1788744975.094558:0:23906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.094566:0:23906:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.094572:0:23906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744975.094579:0:23906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3813f2e00/0x6e465a23bbc29e21 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744975.380372:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744976.413124:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744976.467862:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744961/real 1788744961] req@ffff9ce3a6bb1c00 x1875634419902336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744976.467907:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3a6bb1c00 x1875634419902336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744976.467918:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744961/real 1788744961] req@ffff9ce3a6bb2300 x1875634419902464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744976.467930:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3a6bb2300 x1875634419902464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788744976.467952:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce287a2e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744976.467977:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744976.467981:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419902336:0@lo:8:kworker.0 00000100:00080000:0.0:1788744976.467987:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744976.467993:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744976.467996:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419902464:0@lo:8:kworker.0 00000100:00080000:3.0:1788744976.468208:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744976.468214:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788744976.468218:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce287a2e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744976.468224:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 686 00000100:00080000:3.0:1788744976.468229:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788744976.468240:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce287a2e800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744976.468296:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb3480 x1875634419910528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744976.468311:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744976.468314:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788744976.468316:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744976.468319:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 686 00000100:00080000:3.0:1788744976.468322:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788744976.468328:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce392b85000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744976.468339:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3a6bb1f80 x1875634419910656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744976.468361:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744976.468364:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744976.468367:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744976.468371:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788744976.468396:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419910400:0@lo:400:kworker.0 00000100:00100000:3.0:1788744976.468464:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744976.468498:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744976.468505:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875634419910784:0@lo:400:kworker.0 00000100:00100000:3.0:1788744976.468547:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744976.468595:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419910400 00000100:00100000:3.0:1788744976.468603:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419910400 00000100:00100000:3.0:1788744976.468678:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744976.468686:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875634419910400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744976.468740:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875634419910400:12345-0@lo:400:kworker.0 Request processed in 55us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744976.468754:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744976.468776:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419910784 00000100:00100000:3.0:1788744976.468780:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419910784 00000100:00100000:3.0:1788744976.468807:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744976.468813:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875634419910784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744976.468844:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875634419910784:12345-0@lo:400:kworker.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744976.468850:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788744976.468884:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3bd50ed80 x1875634419910784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744976.468907:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875634419910784:0@lo:400:kworker.0 00000100:00100000:3.0:1788744976.468919:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419910400:0@lo:400:kworker.0 00000100:00100000:3.0:1788744976.468940:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419910528:0@lo:8:kworker.0 00000400:00000100:3.0:1788744976.468959:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419910528 offset 0 length 520: 4 00000100:00100000:3.0:1788744976.468983:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419910656:0@lo:8:kworker.0 00000400:00000100:3.0:1788744976.468996:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419910656 offset 0 length 520: 4 00000100:00100000:2.0:1788744976.469221:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419910912:0@lo:400:kworker.0 00000100:00100000:2.0:1788744976.469280:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744976.469307:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788744976.469313:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419910272:0@lo:400:kworker.0 00000100:00100000:2.0:1788744976.469341:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744976.469356:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419911040:0@lo:400:kworker.0 00000100:00100000:2.0:1788744976.469377:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744976.469674:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419910912 00000100:00100000:3.0:1788744976.469680:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419910912 00000100:00100000:3.0:1788744976.469706:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744976.469713:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419910912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744976.469756:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419910912:12345-0@lo:400:kworker.0 Request processed in 44us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744976.469763:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744976.469791:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419910912:0@lo:400:kworker.0 00000100:00100000:0.0:1788744976.469991:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419910272 00000100:00100000:0.0:1788744976.469996:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419910272 00000100:00100000:0.0:1788744976.470035:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744976.470042:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:3634:x1875634419910272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744976.470079:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:3634:x1875634419910272:12345-0@lo:400:kworker.0 Request processed in 38us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744976.470085:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744976.470119:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419911040 00000100:00100000:0.0:1788744976.470122:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419911040 00000100:00100000:0.0:1788744976.470140:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744976.470146:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419911040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744976.470181:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419911040:12345-0@lo:400:kworker.0 Request processed in 35us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744976.470187:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744976.470752:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419910272:0@lo:400:kworker.0 00010000:00080000:3.0:1788744976.470766:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3bd50c380 x1875634419911040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744976.470776:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419911040:0@lo:400:kworker.0 10000000:01000000:2.0:1788744976.982152:0:22747:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744976.982163:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce3bda7d000 from 13 10000000:01000000:2.0:1788744976.982170:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744976.982240:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744976.982273:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744976.982298:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744976.982326:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744976.982399:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744976.982446:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3b402f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744976.982568:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419911168 00000100:00100000:0.0:1788744976.982578:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419911168 00000100:00100000:0.0:1788744976.982680:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744976.982690:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+16:22747:x1875634419911168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744976.982705:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744976.982718:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29e28 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744976.982745:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744976.982756:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744976.982766:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf7c00, rc 0) 00000100:00100000:0.0:1788744976.982825:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419911168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744976.982833:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788744976.982925:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744976.982943:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744976.982953:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744976.983020:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744976.983051:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744976.983163:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a15480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744976.983264:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419911296 00000100:00100000:2.0:1788744976.983270:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419911296 00000100:00100000:2.0:1788744976.983295:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788744976.983302:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419911296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744976.983426:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419911296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744976.983433:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788744976.985176:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.985265:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.985345:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744976.985377:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce287884b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744976.985409:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419911424 00000100:00100000:1.0:1788744976.985417:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419911424 00000100:00100000:1.0:1788744976.985457:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744976.985466:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419911424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.985574:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419911424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744976.985582:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744976.985642:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788744976.986386:0:23988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788744976.986440:0:22747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788744976.986461:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744976.986472:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744976.986491:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744976.986502:0:22747:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744976.986505:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce3ba964000 from 13 10000000:01000000:1.0:1788744976.986508:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744976.986535:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744976.986543:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744976.986554:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744976.986572:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.991624:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744976.991694:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce287884840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744976.991727:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419911552 00000100:00100000:1.0:1788744976.991740:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419911552 00000100:00100000:1.0:1788744976.991808:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744976.991820:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ba931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+17:22747:x1875634419911552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744976.991840:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744976.991861:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29e36 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744976.991894:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744976.991918:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744976.991929:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403ee00, rc 0) 00000100:00100000:1.0:1788744976.991992:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ba931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:22747:x1875634419911552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744976.992000:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744976.992064:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744976.992086:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744976.992096:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744976.992191:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.992221:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744976.992237:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce287884840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744976.992275:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419911680 00000100:00100000:1.0:1788744976.992280:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419911680 00000100:00100000:1.0:1788744976.992308:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744976.992315:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ba930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:22747:x1875634419911680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.992433:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ba930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:22747:x1875634419911680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744976.992440:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744976.992475:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.992519:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.992559:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744976.992582:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce287884840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744976.992594:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419911808 00000100:00100000:1.0:1788744976.992597:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419911808 00000100:00100000:1.0:1788744976.992634:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744976.992641:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:22747:x1875634419911808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744976.992720:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:22747:x1875634419911808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744976.992726:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744976.992767:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419911808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788744976.993513:0:23990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788744976.993582:0:22747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788744976.993619:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744976.993630:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744976.993640:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744977.424485:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744977.488837:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744967/real 1788744967] req@ffff9ce3a6bb0e00 x1875634419904640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744977 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744977.488874:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3a6bb0e00 x1875634419904640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744977 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744977.488886:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744967/real 1788744967] req@ffff9ce3a6bb2a00 x1875634419904512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744977 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744977.488923:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3a6bb2a00 x1875634419904512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744977 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788744977.488946:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744977.488973:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744977.488978:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419904640:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788744977.488985:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3a0c1b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744977.488991:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744977.488994:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419904512:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788744977.490080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744977.490085:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744977.490088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744977.490091:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744977.490139:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744977.490142:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788744977.490146:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce3a0c1b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744977.490152:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 691 00000100:00080000:2.0:1788744977.490157:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744977.490168:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce3a0c1b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744977.490187:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3be9db800 x1875634419912448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744977.490207:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744977.490210:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788744977.490212:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744977.490216:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 691 00000100:00080000:2.0:1788744977.490218:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744977.490224:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce3945f5000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744977.490239:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3be9db100 x1875634419912576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744977.490305:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419912192:0@lo:400:kworker.0 00000100:00100000:2.0:1788744977.490370:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744977.490405:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744977.490410:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419912320:0@lo:400:kworker.0 00000100:00100000:2.0:1788744977.490434:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744977.490463:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419912192 00000100:00100000:2.0:1788744977.490471:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419912192 00000100:00100000:2.0:1788744977.490518:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744977.490527:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419912192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744977.490576:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419912192:12345-0@lo:400:kworker.0 Request processed in 50us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744977.490583:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744977.490621:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419912320 00000100:00100000:2.0:1788744977.490625:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419912320 00000100:00100000:2.0:1788744977.490649:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744977.490656:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419912320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744977.490686:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419912320:12345-0@lo:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744977.490700:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744977.490749:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419912320:0@lo:400:kworker.0 00010000:00080000:2.0:1788744977.490766:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3bd4c3800 x1875634419912192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744977.490774:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419912192:0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.490896:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419911936:0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.490931:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744977.490962:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875634419912704:0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.490984:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744977.491004:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744977.491009:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419912064:0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.491029:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744977.491057:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419912704 00000100:00100000:0.0:1788744977.491061:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419912704 00000100:00100000:0.0:1788744977.491086:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744977.491092:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875634419912704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.491129:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875634419912704:12345-0@lo:400:kworker.0 Request processed in 36us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744977.491135:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744977.491155:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419911936 00000100:00100000:0.0:1788744977.491166:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419911936 00000100:00100000:0.0:1788744977.491193:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788744977.491199:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:3636:x1875634419911936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.491229:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:3636:x1875634419911936:12345-0@lo:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744977.491235:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788744977.491285:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419912064 00000100:00100000:0.0:1788744977.491289:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419912064 00000100:00100000:0.0:1788744977.491311:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744977.491317:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875634419912064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.491346:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875634419912064:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744977.491352:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744977.491383:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419912064:0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.491391:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419911936:0@lo:400:kworker.0 00010000:00080000:0.0:1788744977.491400:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3be9d9180 x1875634419912704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744977.491409:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875634419912704:0@lo:400:kworker.0 00000100:00100000:0.0:1788744977.491432:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419912448:0@lo:8:kworker.0 00000400:00000100:0.0:1788744977.491455:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419912448 offset 0 length 520: 4 00000100:00100000:0.0:1788744977.491468:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419912576:0@lo:8:kworker.0 00000400:00000100:0.0:1788744977.491483:0:3633:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634419912576 offset 0 length 520: 4 00000100:00100000:2.0:1788744977.492897:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744977.492915:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419912832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744977.493114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744977.493161:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419912832 00000100:00100000:2.0:1788744977.493169:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419912832 00000100:00100000:2.0:1788744977.493226:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744977.493234:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419912832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744977.493297:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788744977.493345:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419912832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744977.493352:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744977.493391:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419912832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788744977.493682:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744977.493693:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419912960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744977.493726:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744977.493793:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419912960 00000100:00100000:0.0:1788744977.493797:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419912960 00000100:00100000:0.0:1788744977.493840:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744977.493847:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875634419912960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744977.493866:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744977.493902:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875634419912960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744977.493908:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744977.493937:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419912960:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788744978.003975:0:23484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788744978.448601:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744979.408891:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788744979.474669:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744980.497182:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744981.520557:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744982.065608:0:24254:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744982.065612:0:24254:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788744982.065613:0:24254:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788744982.065720:0:24254:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ce288114000 00000020:01000004:3.0:1788744982.065736:0:24254:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788744982.065749:0:24254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788744982.065763:0:24254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ce287954d40) 00000020:00000080:3.0:1788744982.065781:0:24254:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788744982.111688:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788744982.112680:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788744982.112992:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788744982.113238:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788744982.113938:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788744982.114184:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788744982.114561:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1788744982.117457:0:24254:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788744982.117788:0:24254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788744982.117803:0:24254:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788744982.117821:0:24254:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6e465a23bbc29e4b 00000020:01000004:2.0:1788744982.117829:0:24254:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788744982.117853:0:24254:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.146@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788744982.117856:0:24254:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788744982.117862:0:24254:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788744982.117867:0:24254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788744982.117878:0:24254:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ce3b39cb380) 00000020:00000080:2.0:1788744982.117889:0:24254:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788744982.119015:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744982.119198:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744982.119205:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788744982.128715:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744982.128746:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788744982.134614:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744982.134629:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788744982.139800:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744982.139996:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788744982.140003:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788744982.140900:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788744982.140908:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788744982.158501:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744982.158776:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744982.158783:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788744982.160603:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788744982.160618:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788744982.161723:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744982.161732:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788744982.164740:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744982.164970:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788744982.164976:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788744982.166529:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788744982.166543:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788744982.200703:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744982.201018:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788744982.201025:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788744982.202602:0:24254:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788744982.202615:0:24254:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788744982.203496:0:24254:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788744982.203536:0:24254:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788744982.203544:0:24254:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788744982.222569:0:24254:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788744982.222618:0:24254:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.146@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788744982.222624:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788744982.222625:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744982.222627:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744982.222628:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744982.222630:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744982.222631:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744982.222633:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744982.222634:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744982.222636:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744982.222640:0:24254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788744982.222642:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744982.222643:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744982.222644:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744982.222646:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744982.222647:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744982.222648:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744982.222649:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744982.222650:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744982.222651:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744982.222696:0:24254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788744982.222718:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788744982.222825:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.222896:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744982.223118:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419913088 00000100:00100000:2.0:1788744982.223127:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419913088 00000100:00100000:2.0:1788744982.223183:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788744982.223193:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:24254:x1875634419913088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788744982.223238:0:22745:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788744982.223268:0:22745:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788744982.223272:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788744982.223711:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:24254:x1875634419913088:12345-0@lo:253:mount.lustre.0 Request processed in 519us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.223720:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744982.223826:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788744982.223838:0:24254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788744982.223841:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744982.223843:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744982.223851:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744982.223852:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744982.223853:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744982.223854:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744982.223856:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744982.223857:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744982.223858:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788744982.223880:0:24254:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce288114000 from lustre-OST0000 10000000:01000000:1.0:1788744982.223934:0:24254:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788744982.223937:0:24254:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788744982.223947:0:24254:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce38fe919c0 local copy 00010000:00010000:1.0:1788744982.223958:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744982.224054:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744982.224084:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.224127:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3883033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744982.224357:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419913216 00000100:00100000:2.0:1788744982.224369:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419913216 00000100:00100000:2.0:1788744982.224399:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744982.224407:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:24254:x1875634419913216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744982.224472:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:24254:x1875634419913216:12345-0@lo:501:mount.lustre.0 Request processed in 66us (387us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744982.224479:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744982.224781:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913216:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788744982.224817:0:24254:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788744982.224836:0:24254:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788744982.224843:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.224853:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744982.224879:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce288114000 10000000:01000000:1.0:1788744982.224884:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788744982.224889:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788744982.224892:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744982.224896:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788744982.224905:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788744982.224928:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f800/0x6e465a23bbc29e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.224937:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f800/0x6e465a23bbc29e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.224947:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f800/0x6e465a23bbc29e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744982.224961:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744982.224992:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.225013:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3883033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744982.225218:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419913344 00000100:00100000:2.0:1788744982.225224:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419913344 00000100:00100000:2.0:1788744982.225284:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744982.225292:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+18:24254:x1875634419913344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744982.225303:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744982.225425:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3813f3200/0x6e465a23bbc29e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29e59 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744982.225449:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3813f3200/0x6e465a23bbc29e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29e59 expref: 19 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744982.225458:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3813f3200/0x6e465a23bbc29e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e59 expref: 19 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744982.225467:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3813f3200, rc 0) 00000100:00100000:2.0:1788744982.225502:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913344:12345-0@lo:101:mount.lustre.0 Request processed in 211us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.225508:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744982.225617:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744982.225631:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f800/0x6e465a23bbc29e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e60 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.225640:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f800/0x6e465a23bbc29e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29e60 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744982.226717:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788744982.228091:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744982.228467:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788744982.228494:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788744982.228508:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788744982.228534:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788744982.228549:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788744982.228563:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788744982.228577:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788744982.228589:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788744982.228615:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788744982.228628:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788744982.228639:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788744982.228650:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788744982.228665:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788744982.228669:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788744982.228766:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744982.228848:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.228901:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744982.229035:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419913472 00000100:00100000:0.0:1788744982.229043:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419913472 00000100:00100000:0.0:1788744982.229145:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788744982.229155:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744982.229386:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913472:12345-0@lo:501:mount.lustre.0 Request processed in 232us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744982.229394:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744982.229512:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744982.229562:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744982.229605:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.229956:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744982.230396:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419913600 00000100:00100000:3.0:1788744982.230405:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419913600 00000100:00100000:3.0:1788744982.230442:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788744982.230451:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744982.231359:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913600:12345-0@lo:503:mount.lustre.0 Request processed in 905us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744982.231369:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788744982.231566:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788744982.232038:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744982.232154:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.232201:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.232234:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3883033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744982.232529:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419913728 00000100:00100000:3.0:1788744982.232536:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419913728 00000100:00100000:3.0:1788744982.232573:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744982.232582:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744982.233066:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913728:12345-0@lo:502:mount.lustre.0 Request processed in 483us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744982.233074:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788744982.233443:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744982.233675:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788744982.233710:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788744982.233724:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788744982.233737:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788744982.233751:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788744982.233764:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788744982.233779:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788744982.233920:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788744982.233950:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788744982.233965:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788744982.233978:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788744982.233990:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788744982.234026:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.234085:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.234206:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3883033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744982.234280:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419913856 00000100:00100000:3.0:1788744982.234288:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419913856 00000100:00100000:3.0:1788744982.234410:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744982.234420:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744982.234538:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913856:12345-0@lo:502:mount.lustre.0 Request processed in 120us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744982.234546:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788744982.234726:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744982.234772:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788744982.234782:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788744982.236060:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788744982.236073:0:24271:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788744982.236081:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744982.236084:0:24271:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788744982.236093:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744982.236190:0:24271:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ce2876219c0) 00000020:00000080:0.0:1788744982.236224:0:24271:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788744982.236233:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788744982.236460:0:24271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce288114000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788744982.236470:0:24271:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744982.236478:0:24271:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6e465a23bbc29e6e 00010000:00010000:0.0:1788744982.242037:0:24271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788744982.243085:0:24271:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1788744982.245856:0:24271:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788744982.247890:0:24271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788744982.247901:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744982.247907:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744982.247909:0:24271:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788744982.247914:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788744982.247922:0:24271:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788744982.247924:0:24271:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744982.247926:0:24271:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744982.247927:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788744982.247930:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744982.247931:0:24271:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788744982.247933:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744982.247936:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744982.247938:0:24271:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788744982.247941:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788744982.247943:0:24271:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788744982.247945:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744982.247947:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744982.247949:0:24271:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788744982.247951:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744982.247953:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744982.247954:0:24271:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788744982.247957:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788744982.247988:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744982.247991:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744982.247992:0:24271:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788744982.247995:0:24271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788744982.248286:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788744982.248328:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788744982.248347:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f800/0x6e465a23bbc29e59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e60 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.248359:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f800/0x6e465a23bbc29e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e60 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744982.248367:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce288114000 from 1 10000000:01000000:1.0:1788744982.248370:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744982.248408:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.248415:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.248427:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744982.248452:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744982.248540:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.248586:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3883030c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744982.248709:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419913984 00000100:00100000:3.0:1788744982.248717:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419913984 00000100:00100000:3.0:1788744982.248767:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744982.248778:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:24254:x1875634419913984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744982.248792:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744982.248804:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29e75 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744982.248830:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744982.248840:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744982.248849:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce381490600, rc 0) 00000100:00100000:3.0:1788744982.248887:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419913984:12345-0@lo:101:mount.lustre.0 Request processed in 112us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744982.248895:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788744982.249490:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419913984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744982.249505:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.249523:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744982.251352:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788744982.251679:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744982.252049:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788744982.252077:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788744982.252103:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788744982.252122:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788744982.252135:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788744982.252147:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788744982.252161:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788744982.252175:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788744982.252188:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788744982.252201:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788744982.252215:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788744982.252233:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788744982.252238:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788744982.252489:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744982.252564:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.252606:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744982.252681:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419914112 00000100:00100000:2.0:1788744982.252689:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419914112 00000100:00100000:2.0:1788744982.252735:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788744982.252745:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744982.252986:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914112:12345-0@lo:501:mount.lustre.0 Request processed in 243us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.252995:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744982.253138:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744982.253170:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744982.253216:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.253240:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744982.253336:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419914240 00000100:00100000:2.0:1788744982.253340:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419914240 00000100:00100000:2.0:1788744982.253369:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744982.253376:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744982.253454:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914240:12345-0@lo:503:mount.lustre.0 Request processed in 78us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.253461:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788744982.253675:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788744982.254129:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744982.254207:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.254399:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.254430:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3883030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744982.254540:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419914368 00000100:00100000:2.0:1788744982.254546:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419914368 00000100:00100000:2.0:1788744982.254579:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744982.254586:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744982.254730:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914368:12345-0@lo:502:mount.lustre.0 Request processed in 144us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.254737:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788744982.256408:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744982.256652:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788744982.256679:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788744982.256690:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788744982.256701:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788744982.256711:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788744982.256722:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788744982.256749:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788744982.256761:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788744982.256771:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788744982.256781:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788744982.257162:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788744982.257203:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744982.257285:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744982.257386:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419914496 00000100:00100000:3.0:1788744982.257393:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419914496 00000100:00100000:3.0:1788744982.257434:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788744982.257441:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744982.257542:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914496:12345-0@lo:502:mount.lustre.0 Request processed in 101us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744982.257550:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788744982.257594:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce394557300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744982.257611:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744982.257653:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788744982.257660:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788744982.261719:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744982.261732:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744982.261735:0:24275:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788744982.261742:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce288114000 00000020:00000080:3.0:1788744982.261745:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744982.261753:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744982.261755:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744982.261757:0:24275:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788744982.261759:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744982.261762:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744982.261763:0:24275:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788744982.261766:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce288114000 00000020:00000080:3.0:1788744982.261775:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744982.262963:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744982.262973:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744982.262975:0:24275:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788744982.262978:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744982.262981:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744982.262982:0:24275:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744982.262986:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce288114000 00000020:00000080:3.0:1788744982.262988:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744982.264197:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744982.264208:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744982.264210:0:24275:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744982.264213:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744982.264216:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744982.264217:0:24275:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788744982.264222:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce288114000 00000020:00000080:3.0:1788744982.264224:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744982.264940:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744982.264946:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744982.264948:0:24275:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788744982.264951:0:24275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788744982.265182:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788744982.265214:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744982.265469:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.265482:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744982.265550:0:24254:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788744982.265553:0:24254:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce288114000 10000000:01000000:1.0:1788744982.265557:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce288114000 10000000:01000000:1.0:1788744982.265561:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744982.265568:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ce288114000 from 1 10000000:01000000:1.0:1788744982.265571:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788744982.265612:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403ec00/0x6e465a23bbc29e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.265620:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3b403ec00/0x6e465a23bbc29e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.265632:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3b403ec00/0x6e465a23bbc29e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744982.265675:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744982.265748:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.265900:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744982.269746:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419914624 00000100:00100000:3.0:1788744982.269762:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419914624 00000100:00100000:3.0:1788744982.269830:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788744982.269842:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:24254:x1875634419914624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744982.269860:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744982.269880:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce381491600/0x6e465a23bbc29e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29e83 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744982.269909:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce381491600/0x6e465a23bbc29e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29e83 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744982.269934:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce381491600/0x6e465a23bbc29e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e83 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744982.269944:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce381491600, rc 0) 00000100:00100000:3.0:1788744982.271622:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419914624:12345-0@lo:101:mount.lustre.0 Request processed in 1776us (5866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744982.271633:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788744982.273430:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744982.273464:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3b403ec00/0x6e465a23bbc29e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e8a expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.273477:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3b403ec00/0x6e465a23bbc29e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29e8a expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744982.276537:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788744982.277186:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744982.277984:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788744982.278019:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788744982.278034:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788744982.278047:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788744982.278059:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788744982.278071:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788744982.278083:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788744982.278904:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788744982.278936:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788744982.278950:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788744982.278964:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788744982.278980:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788744982.278992:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788744982.279005:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788744982.279036:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788744982.279052:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788744982.279064:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788744982.279089:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788744982.279175:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788744982.279193:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788744982.279207:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788744982.279219:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788744982.279233:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788744982.279265:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788744982.279282:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788744982.279295:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788744982.281170:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788744982.281241:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788744982.281277:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788744982.281292:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788744982.281437:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788744982.281457:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788744982.281472:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788744982.281486:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788744982.281500:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788744982.281583:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788744982.281607:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788744982.281619:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788744982.281631:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788744982.281642:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788744982.281653:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788744982.281665:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788744982.281676:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788744982.281689:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788744982.281702:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788744982.281714:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788744982.281743:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788744982.281760:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788744982.282179:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788744982.282202:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788744982.282232:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788744982.282238:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788744982.283963:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744982.284032:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.284588:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744982.284947:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419914752 00000100:00100000:3.0:1788744982.284955:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419914752 00000100:00100000:3.0:1788744982.285010:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788744982.285019:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419914752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744982.285303:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419914752:12345-0@lo:501:mount.lustre.0 Request processed in 284us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744982.285485:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744982.285538:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744982.285583:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.285609:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744982.285647:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788744982.285672:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419914880 00000100:00100000:3.0:1788744982.285676:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419914880 00000100:00100000:3.0:1788744982.285692:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788744982.285697:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419914880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744982.286749:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419914880:12345-0@lo:503:mount.lustre.0 Request processed in 1047us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744982.286759:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788744982.287578:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419914880:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788744982.288022:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744982.288119:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419915008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.288189:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.288231:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744982.288294:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419915008 00000100:00100000:1.0:1788744982.288301:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419915008 00000100:00100000:1.0:1788744982.288351:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788744982.288359:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419915008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.288456:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419915008:12345-0@lo:502:mount.lustre.0 Request processed in 96us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744982.288463:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788744982.288510:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419915008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744982.288692:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788744982.288720:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788744982.288736:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788744982.288763:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788744982.288778:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788744982.288790:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788744982.288803:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788744982.288817:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788744982.288849:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788744982.288865:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788744982.288881:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788744982.288895:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788744982.288908:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788744982.288922:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788744982.288940:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788744982.288954:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788744982.288967:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788744982.288980:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788744982.288994:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788744982.289007:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788744982.289020:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788744982.289032:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788744982.289045:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788744982.289060:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788744982.289088:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788744982.289103:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788744982.289117:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788744982.289132:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788744982.289145:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788744982.289159:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788744982.289173:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788744982.289186:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788744982.289200:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788744982.289214:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788744982.289226:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788744982.289238:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788744982.289289:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788744982.289304:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788744982.289317:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788744982.289330:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788744982.289358:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788744982.289374:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788744982.289388:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788744982.289403:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788744982.289415:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788744982.289427:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788744982.289441:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788744982.289455:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788744982.289492:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419915136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.289560:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.289593:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419915136 00000100:00100000:1.0:1788744982.289599:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419915136 00000100:00100000:1.0:1788744982.289625:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788744982.289632:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419915136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.289707:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419915136:12345-0@lo:502:mount.lustre.0 Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744982.289714:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788744982.289759:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744982.289776:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419915136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744982.289898:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788744982.289917:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788744982.289936:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419915264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.289967:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.289987:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419915264 00000100:00100000:1.0:1788744982.289996:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419915264 00000100:00100000:1.0:1788744982.290014:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788744982.290020:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419915264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744982.290074:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419915264:12345-0@lo:502:mount.lustre.0 Request processed in 53us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744982.290080:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788744982.290106:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744982.290118:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419915264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744982.290147:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788744982.290155:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788744982.299625:0:24280:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788744982.299646:0:24280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ce287620000) 00000020:00000080:0.0:1788744982.299671:0:24280:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788744982.299754:0:24280:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce288114000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788744982.299759:0:24280:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce288114000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788744982.299762:0:24280:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce288114000 3 00010000:00080000:0.0:1788744982.299870:0:24280:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce285a17000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.146@tcp at head 00010000:00010000:2.0:1788744982.323475:0:24280:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788744982.324049:0:24280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788744982.324114:0:24280:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788744982.324127:0:24280:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6e465a23bbc29e98 00000100:00080000:2.0:1788744982.324139:0:24280:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744982.324151:0:24280:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ce285a17000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744982.324191:0:24280:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3be9d9c00 x1875634419915392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744982.324220:0:24280:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788744982.324282:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744982.324286:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744982.324289:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744982.324292:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744982.324525:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744982.324539:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744982.324542:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744982.324544:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744982.324602:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419915520:0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.324672:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744982.324708:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744982.324714:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875634419915904:0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.324737:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744982.324771:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875634419915648:0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.324792:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744982.324810:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744982.324816:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419915776:0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.324835:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744982.324864:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419915520 00000100:00100000:2.0:1788744982.324871:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419915520 00000100:00100000:2.0:1788744982.324908:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419915776 00000100:00100000:2.0:1788744982.324911:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419915776 00000100:00100000:2.0:1788744982.324927:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744982.324935:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419915520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.324987:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419915520:12345-0@lo:400:kworker.0 Request processed in 52us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.324994:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744982.325011:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744982.325017:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419915776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.325048:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419915776:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.325063:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744982.325088:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419915904 00000100:00100000:2.0:1788744982.325092:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419915904 00000100:00100000:2.0:1788744982.325114:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419915648 00000100:00100000:2.0:1788744982.325117:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419915648 00000100:00100000:2.0:1788744982.325130:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744982.325136:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875634419915904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.325168:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875634419915904:12345-0@lo:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.325174:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744982.325186:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744982.325193:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875634419915648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.325217:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875634419915648:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.325223:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744982.325289:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419915776:0@lo:400:kworker.0 00010000:00080000:2.0:1788744982.325301:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3be9d8700 x1875634419915648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744982.325326:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875634419915648:0@lo:400:kworker.0 00010000:00080000:2.0:1788744982.325356:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3be9dbb80 x1875634419915904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744982.325365:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875634419915904:0@lo:400:kworker.0 00000100:00100000:2.0:1788744982.325374:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419915520:0@lo:400:kworker.0 00000020:01000004:2.0:1788744982.325590:0:24280:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788744982.325608:0:24280:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ce3b39c99c0) 00000020:00000080:2.0:1788744982.325625:0:24280:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788744982.325691:0:24280:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce288114000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788744982.325695:0:24280:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce288114000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788744982.325697:0:24280:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce288114000 3 00010000:00080000:2.0:1788744982.325721:0:24280:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce3bd200000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.146@tcp at head 00000100:00100000:1.0:1788744982.329599:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1875634419915392:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788744982.329683:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.329764:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419915392 00000100:00100000:1.0:1788744982.329774:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419915392 00000100:00100000:1.0:1788744982.329827:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744982.329836:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1875634419915392:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788744982.329869:0:22752:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:1.0:1788744982.329910:0:22752:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6e465a23bbc29ea6 00000004:00100000:1.0:1788744982.329927:0:22752:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744982.329971:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9ce3bf8f3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744982.330026:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875634419915392:12345-0@lo:38:llog_process_th.0 Request processed in 190us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744982.330033:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788744982.330076:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3be9d9c00 x1875634419915392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744982.330086:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00010000:00010000:2.0:1788744982.332818:0:24280:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788744982.333038:0:24280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788744982.333091:0:24280:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788744982.333105:0:24280:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6e465a23bbc29ead 00000100:00080000:2.0:1788744982.333118:0:24280:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744982.333130:0:24280:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ce3bd200000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744982.333167:0:24280:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3be9d8a80 x1875634419916032/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744982.333184:0:24280:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788744982.333217:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744982.333222:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744982.333224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744982.333227:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744982.333231:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744982.333234:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744982.333237:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744982.333239:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744982.335193:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788744982.335209:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788744982.335214:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788744982.335218:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce285a17000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744982.335227:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1875634419915392:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788744982.335278:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1875634419916032:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788744982.335427:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744982.335528:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419916032 00000100:00100000:0.0:1788744982.335537:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419916032 00000100:00100000:0.0:1788744982.335573:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744982.335580:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1875634419916032:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788744982.335607:0:22751:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:0.0:1788744982.335654:0:22751:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6e465a23bbc29eb4 00000004:00100000:0.0:1788744982.335670:0:22751:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744982.335701:0:22751:0:(import.c:65:import_set_state_nolock()) ffff9ce285a15800 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788744982.335714:0:24280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:0.0:1788744982.335748:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875634419916032:12345-0@lo:38:llog_process_th.0 Request processed in 167us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744982.335755:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788744982.336870:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ce3be9d8a80 x1875634419916032/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744982.336883:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744982.336892:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788744982.336900:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788744982.336904:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788744982.336906:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd200000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744982.336912:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1875634419916032:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788744982.336967:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788744982.337002:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788744982.337020:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403ec00/0x6e465a23bbc29e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e8a expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.337030:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3b403ec00/0x6e465a23bbc29e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29e8a expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788744982.337079:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788744982.337081:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744982.337082:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744982.337089:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744982.337090:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744982.337102:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744982.337104:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744982.337106:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744982.337107:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788744982.337111:0:24254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788744982.337113:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744982.337114:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744982.337114:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744982.337115:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744982.337116:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744982.337117:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744982.337117:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744982.337118:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744982.337119:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788744982.337142:0:24254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788744982.337157:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419916160:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788744982.337208:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.337268:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388303f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744982.337469:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419916160 00000100:00100000:0.0:1788744982.337477:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419916160 00000100:00100000:0.0:1788744982.337533:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788744982.337542:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419916160:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788744982.337566:0:22742:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788744982.337580:0:22742:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788744982.352605:0:22742:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788744982.352631:0:22742:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788744982.352940:0:22766:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744982.352946:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744982.352981:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.353002:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.353009:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.353016:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.353055:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.353069:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 21 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744982.353082:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419916288:0@lo:104: 00000100:00100000:0.0:1788744982.353167:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744982.353236:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.353282:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 21 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744982.353292:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419916416:0@lo:104: 00000100:00100000:0.0:1788744982.353325:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744982.353344:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744982.353735:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788744982.353765:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419916288 00000100:00100000:2.0:1788744982.353772:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419916288 00000100:00100000:2.0:1788744982.353861:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419916416 00000100:00100000:2.0:1788744982.353865:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419916416 00000100:00100000:2.0:1788744982.353881:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744982.353889:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:22766:x1875634419916288:12345-0@lo:104: 00010000:00010000:2.0:1788744982.353901:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744982.353959:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744982.353966:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:22766:x1875634419916288:12345-0@lo:104: Request processed in 78us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744982.353972:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744982.353990:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744982.353996:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ba931c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:22766:x1875634419916416:12345-0@lo:104: 00010000:00010000:2.0:1788744982.354003:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744982.354009:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419916288:0@lo:104: 00010000:00010000:2.0:1788744982.354036:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788744982.354041:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ba931c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:22766:x1875634419916416:12345-0@lo:104: Request processed in 46us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744982.354042:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419916416:0@lo:104: 00000100:00100000:2.0:1788744982.354047:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788744982.354068:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744982.354343:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:24254:x1875634419916160:12345-0@lo:253:mount.lustre.0 Request processed in 16802us (17133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744982.354351:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788744982.357534:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:24254:1875634419916160:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788744982.357564:0:24254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788744982.357568:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744982.357570:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744982.357572:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744982.357573:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744982.357574:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744982.357575:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744982.357577:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744982.357580:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744982.357582:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788744982.357605:0:24254:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788744982.357706:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744982.357717:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357727:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf6a00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:0.0:1788744982.357732:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357743:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744982.357750:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744982.357756:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744982.357808:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357814:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744982.357837:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357844:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf6a00/0x6e465a23bbc29e0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e13 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357876:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744982.357879:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357885:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3c21c9400 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:0.0:1788744982.357888:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357895:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744982.357902:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744982.357907:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744982.357930:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357936:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744982.357951:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357958:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3c21c9400/0x6e465a23bbc29dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e05 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744982.357973:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744982.357975:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744982.357977:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744982.357983:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744982.358009:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744982.358026:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419916672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744982.358106:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.358158:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419916672 00000100:00100000:1.0:1788744982.358165:0:22736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419916672 00010000:00010000:1.0:1788744982.358192:0:22736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 21 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744982.358242:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744982.358279:0:22736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:3637:x1875634419916672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744982.358296:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744982.358302:0:22736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 21 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.360114:0:22736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 21 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.360135:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3c21c9800/0x6e465a23bbc29e05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29dfe expref: 21 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.360152:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744982.360235:0:22736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:3637:x1875634419916672:12345-0@lo:103:ldlm_bl.0 Request processed in 1959us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744982.360257:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744982.361334:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419916672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744982.362339:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744982.362360:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419916544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744982.362433:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744982.362717:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419916544 00000100:00100000:1.0:1788744982.362726:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419916544 00010000:00010000:1.0:1788744982.362763:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 20 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744982.362816:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744982.362829:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:3634:x1875634419916544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744982.362844:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744982.362849:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 20 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.362862:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 20 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.362916:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3c21c8600/0x6e465a23bbc29e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29e0c expref: 20 pid: 22745 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.362939:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363213:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744982.363231:0:22737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010286024s 00010000:00010000:1.0:1788744982.363236:0:22737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363269:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363277:0:22737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363284:0:22737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363291:0:22737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:1.0:1788744982.363295:0:22737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363303:0:22737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363333:0:22737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363352:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744982.363408:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287b0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:3634:x1875634419916544:12345-0@lo:103:ldlm_bl.0 Request processed in 584us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744982.363416:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788744982.363480:0:22766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363489:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744982.363496:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3a6bf7e00/0x6e465a23bbc29ebb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744982.363568:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419916544:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788744982.375065:0:24254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788744982.385333:0:24254:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788744982.385343:0:24254:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788744982.385380:0:24254:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788744982.385430:0:24254:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788744982.385449:0:24254:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788744982.385472:0:24254:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788744982.386217:0:24254:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744982.386507:0:24254:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744982.545458:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744982.609562:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419916800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744982.609638:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744982.609879:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419916800 00000100:00100000:0.0:1788744982.609889:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419916800 00000100:00100000:0.0:1788744982.609936:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788744982.609946:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419916800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744982.609981:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744982.610027:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419916800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744982.610033:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788744982.610078:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419916800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744982.617681:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744982.617849:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419916928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744982.617936:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744982.617996:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419916928 00000100:00100000:0.0:1788744982.618005:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419916928 00000100:00100000:0.0:1788744982.618046:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744982.618055:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419916928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788744982.618536:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788744982.618593:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419916928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 537us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744982.618601:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744982.618655:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419916928:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788744983.343196:0:24333:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788744983.344583:0:24333:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744983.571209:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744983.760383:0:22747:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744983.760391:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3bda7d000 from 13 10000000:01000000:0.0:1788744983.760397:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744983.760452:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744983.760465:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744983.760479:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744983.760522:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419917056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744983.760627:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744983.760739:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744983.760972:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419917056 00000100:00100000:3.0:1788744983.760982:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419917056 00000100:00100000:3.0:1788744983.761090:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788744983.761101:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+19:22747:x1875634419917056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744983.761117:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744983.761150:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29ec2 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744983.761177:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744983.761189:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744983.761198:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce381490400, rc 0) 00000100:00100000:3.0:1788744983.761300:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:22747:x1875634419917056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744983.761308:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788744983.761392:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419917056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744983.761409:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744983.761418:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744983.761472:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419917184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744983.761514:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744983.761742:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744983.761822:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419917184 00000100:00100000:2.0:1788744983.761828:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419917184 00000100:00100000:1.0:1788744983.762004:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788744983.762014:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:22747:x1875634419917184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788744983.762430:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788744983.762455:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788744983.762459:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788744983.762685:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:22747:x1875634419917184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 672us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744983.762693:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788744983.762768:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419917184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788744983.762851:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744983.762862:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744983.762871:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744983.762881:0:22747:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744983.762883:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3ba964000 from 13 10000000:01000000:0.0:1788744983.762886:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744983.762913:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744983.762921:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744983.762941:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744983.762960:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419917312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744983.762989:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744983.763066:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744983.763105:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419917312 00000100:00100000:1.0:1788744983.763112:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419917312 00000100:00100000:1.0:1788744983.763233:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788744983.763242:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:22747:x1875634419917312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744983.763275:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744983.763293:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29ed0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744983.763314:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 21 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744983.763324:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 21 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744983.763331:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403e200, rc 0) 00000100:00100000:1.0:1788744983.763367:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419917312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744983.763373:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788744983.763480:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419917312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744983.763501:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744983.763511:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744983.763552:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419917440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744983.763585:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744983.763611:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744983.763680:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419917440 00000100:00100000:1.0:1788744983.763685:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419917440 00000100:00100000:1.0:1788744983.763747:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744983.763754:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419917440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788744983.763765:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788744983.763779:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788744983.763782:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788744983.763989:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419917440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 235us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744983.763997:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788744983.764054:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419917440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788744983.764112:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788744983.764119:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744983.764214:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744984.016878:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744984.594321:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744985.617325:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744986.643412:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744987.668919:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744987.728415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744987.728435:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744987.728439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744987.728442:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744987.728464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744987.728468:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744987.728471:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744987.728474:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744987.728528:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875634419917824:0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.728621:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744987.728689:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1875634419918336:0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.728721:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744987.728750:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788744987.728755:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419917696:0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.728785:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744987.728821:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1875634419918208:0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.728847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744987.728888:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419917824 00000100:00100000:2.0:1788744987.728898:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419917824 00000100:00100000:2.0:1788744987.728958:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419918336 00000100:00100000:2.0:1788744987.728962:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419918336 00000100:00100000:2.0:1788744987.728989:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419918208 00000100:00100000:2.0:1788744987.728992:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419918208 00000100:00100000:2.0:1788744987.729012:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744987.729021:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875634419917824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.729085:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875634419917824:12345-0@lo:400:kworker.0 Request processed in 64us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744987.729094:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744987.729115:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744987.729122:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875634419918336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.729150:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875634419918336:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744987.729155:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744987.729167:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744987.729173:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875634419918208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.729199:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875634419918208:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744987.729205:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744987.729232:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419917696 00000100:00100000:2.0:1788744987.729236:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419917696 00000100:00100000:2.0:1788744987.729287:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788744987.729294:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419917696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.729327:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419917696:12345-0@lo:400:kworker.0 Request processed in 34us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744987.729333:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788744987.729381:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419917696:0@lo:400:kworker.0 00010000:00080000:2.0:1788744987.729403:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3be9dbb80 x1875634419918208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744987.729415:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1875634419918208:0@lo:400:kworker.0 00010000:00080000:2.0:1788744987.729439:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3be9d8000 x1875634419917824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744987.729448:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875634419917824:0@lo:400:kworker.0 00010000:00080000:2.0:1788744987.729458:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3be9d8a80 x1875634419918336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744987.729465:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1875634419918336:0@lo:400:kworker.0 00000100:00100000:1.0:1788744987.730451:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419917952:0@lo:400:kworker.0 00000100:00100000:1.0:1788744987.730521:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744987.730578:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744987.730601:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419917568:0@lo:400:kworker.0 00000100:00100000:1.0:1788744987.730635:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744987.730697:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419918080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744987.730728:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788744987.730797:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744987.730803:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788744987.730821:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419917568 00000100:00100000:1.0:1788744987.730829:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419917568 00000100:00100000:1.0:1788744987.730873:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788744987.730883:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:3634:x1875634419917568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744987.730936:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:3634:x1875634419917568:12345-0@lo:400:kworker.0 Request processed in 55us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744987.730944:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788744987.730992:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419917568:0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.731161:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419917952 00000100:00100000:2.0:1788744987.731167:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419917952 00000100:00100000:2.0:1788744987.731205:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788744987.731213:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419917952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.731290:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419917952:12345-0@lo:400:kworker.0 Request processed in 78us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744987.731297:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788744987.731315:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419918080 00000100:00100000:2.0:1788744987.731318:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419918080 00000100:00100000:2.0:1788744987.731342:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744987.731349:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419918080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.731382:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419918080:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744987.731388:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788744987.731417:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3be9daa00 x1875634419918080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744987.731448:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419918080:0@lo:400:kworker.0 00000100:00100000:2.0:1788744987.731462:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419917952:0@lo:400:kworker.0 00000100:00100000:0.0:1788744987.731710:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744987.731723:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419918464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788744987.731759:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744987.731826:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419918464 00000100:00100000:0.0:1788744987.731830:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419918464 00000100:00100000:0.0:1788744987.731860:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744987.731867:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419918464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744987.731901:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744987.731941:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419918464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744987.731955:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744987.731989:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419918464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744987.732234:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744987.732261:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419918592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744987.732289:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744987.732314:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419918592 00000100:00100000:2.0:1788744987.732318:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419918592 00000100:00100000:2.0:1788744987.732340:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744987.732346:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419918592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788744987.732368:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788744987.732400:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419918592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744987.732406:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744987.732448:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419918592:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788744988.689808:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788744989.652960:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744989.718676:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744990.107110:0:24624:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788744990.736410:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788744991.089210:0:24676:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788744991.089570:0:24676:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788744991.760901:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788744992.177144:0:24726:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788744992.177521:0:24726:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788744992.594185:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744977/real 1788744977] req@ffff9ce3be9db800 x1875634419912448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744992 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744992.594221:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3be9db800 x1875634419912448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744992 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744992.594233:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744977/real 1788744977] req@ffff9ce3be9db100 x1875634419912576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744992 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744992.594265:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3be9db100 x1875634419912576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744992 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744992.594285:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3a0c1b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744992.594310:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744992.594315:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419912448:0@lo:8:kworker.0 00000100:00080000:3.0:1788744992.594321:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744992.594354:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744992.594357:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419912576:0@lo:8:kworker.0 00000100:00080000:2.0:1788744992.594526:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744992.594531:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744992.594533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744992.594536:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744992.594574:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744992.594578:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788744992.594586:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ce3a0c1b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744992.594591:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 702 00000100:00080000:2.0:1788744992.594597:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788744992.594607:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ce3a0c1b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744992.594628:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3be9db800 x1875634419919232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744992.594643:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744992.594646:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788744992.594648:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744992.594650:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 702 00000100:00080000:2.0:1788744992.594653:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788744992.594657:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce3945f5000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1788744992.594668:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3be9d9f80 x1875634419919360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744992.594727:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419919104:0@lo:400:kworker.0 00000100:00100000:2.0:1788744992.594793:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744992.594855:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788744992.594863:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419918976:0@lo:400:kworker.0 00000100:00100000:2.0:1788744992.594889:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744992.594908:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1875634419919744:0@lo:400:kworker.0 00000100:00100000:2.0:1788744992.594928:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744992.594956:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419919104 00000100:00100000:2.0:1788744992.594965:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419919104 00000100:00100000:2.0:1788744992.595025:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744992.595035:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419919104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744992.595100:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419919104:12345-0@lo:400:kworker.0 Request processed in 66us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744992.595107:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744992.595133:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419918976 00000100:00100000:2.0:1788744992.595137:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419918976 00000100:00100000:2.0:1788744992.595163:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419919744 00000100:00100000:2.0:1788744992.595166:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419919744 00000100:00100000:2.0:1788744992.595192:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744992.595198:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419918976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744992.595228:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419918976:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744992.595234:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744992.595274:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744992.595280:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875634419919744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744992.595305:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875634419919744:12345-0@lo:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744992.595311:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788744992.595387:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788744992.595401:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419919232:0@lo:8:kworker.0 00000100:00100000:2.0:1788744992.595447:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744992.595476:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419919360:0@lo:8:kworker.0 00000100:00100000:2.0:1788744992.595499:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744992.595534:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419919232 00000100:00100000:2.0:1788744992.595538:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419919232 00000100:00100000:2.0:1788744992.595553:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419919360 00000100:00100000:2.0:1788744992.595555:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419919360 00000100:00100000:2.0:1788744992.595564:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744992.595575:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419919232:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788744992.595605:0:24258:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:2.0:1788744992.595632:0:24258:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6e465a23bbc29ede 00002000:00100000:2.0:1788744992.595646:0:24258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ce3bd205800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788744992.595651:0:24258:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788744992.595654:0:24258:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788744992.595851:0:24258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788744992.595883:0:24258:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd206000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744992.595922:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1875634419919232:12345-0@lo:8:kworker.0 Request processed in 345us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744992.595929:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744992.595942:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744992.595945:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419919360:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788744992.595957:0:24258:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788744992.597450:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bd4c3800 x1875634419918976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744992.597468:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419918976:0@lo:400:kworker.0 00010000:00080000:1.0:1788744992.597482:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3be9d8a80 x1875634419919744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744992.597489:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1875634419919744:0@lo:400:kworker.0 00000100:00100000:1.0:1788744992.597501:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419919104:0@lo:400:kworker.0 00010000:00080000:1.0:1788744992.597553:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3be9db800 x1875634419919232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788745012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744992.597575:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744992.597583:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788744992.597593:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788744992.597599:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788744992.597602:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3a0c1b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788744992.597616:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788744992.597622:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419919232:0@lo:8:kworker.0 00000100:00100000:0.0:1788744992.598093:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419918720:0@lo:400:kworker.0 00000100:00100000:0.0:1788744992.598160:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744992.598211:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875634419919488:0@lo:400:kworker.0 00000100:00100000:0.0:1788744992.598236:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744992.598302:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788744992.598308:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419918848:0@lo:400:kworker.0 00000100:00100000:0.0:1788744992.598347:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744992.598369:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1875634419919616:0@lo:400:kworker.0 00000100:00100000:0.0:1788744992.598393:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788744992.598455:0:23493:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788744992.598478:0:23493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23493:1875634419920000:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788744992.598502:0:23493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744992.598517:0:23493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce281083000 going to sleep for 11 seconds 00000004:00080000:0.0:1788744992.598530:0:23492:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788744992.598630:0:23492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 717541384302ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788744992.598637:0:23492:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788744992.598667:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419918848 00000100:00100000:0.0:1788744992.598675:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419918848 00000100:00100000:0.0:1788744992.598741:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744992.598751:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419918848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744992.598821:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419918848:12345-0@lo:400:kworker.0 Request processed in 71us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744992.598828:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744992.598984:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419919488 00000100:00100000:0.0:1788744992.599129:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419919488 00000100:00100000:0.0:1788744992.599159:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419919616 00000100:00100000:0.0:1788744992.599162:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419919616 00000100:00100000:0.0:1788744992.599188:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744992.599194:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875634419919488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744992.599229:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875634419919488:12345-0@lo:400:kworker.0 Request processed in 34us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744992.599235:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744992.599269:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744992.599275:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875634419919616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744992.599300:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875634419919616:12345-0@lo:400:kworker.0 Request processed in 26us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744992.599305:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744992.599330:0:24261:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788744992.599350:0:24261:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788744992.599493:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744992.599506:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419919872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788744992.599534:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744992.599569:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419919872 00000100:00100000:0.0:1788744992.599572:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419919872 00000100:00100000:0.0:1788744992.599598:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744992.599605:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3634:x1875634419919872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788744992.599625:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788744992.599668:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3634:x1875634419919872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744992.599674:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744992.600102:0:24260:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744992.600114:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419920000 00000100:00100000:3.0:1788744992.600118:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419920000 00000100:00100000:1.0:1788744992.600792:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419918720 00000100:00100000:1.0:1788744992.600798:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419918720 00000100:00100000:1.0:1788744992.600843:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788744992.600850:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:3636:x1875634419918720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744992.600901:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:3636:x1875634419918720:12345-0@lo:400:kworker.0 Request processed in 52us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744992.600906:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788744992.600960:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744992.600966:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744992.601013:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419918848:0@lo:400:kworker.0 00010000:00080000:1.0:1788744992.601029:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3be9d8700 x1875634419919616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744992.601040:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1875634419919616:0@lo:400:kworker.0 00000100:00100000:1.0:1788744992.601049:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419918720:0@lo:400:kworker.0 00010000:00080000:1.0:1788744992.601058:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3be9daa00 x1875634419919488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744992.601065:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875634419919488:0@lo:400:kworker.0 00010000:00080000:1.0:1788744992.601314:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bcf7d500 x1875634419919872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788745008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744992.601332:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419919872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788744992.601466:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744992.601474:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23493:x1875634419920000:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788744992.608469:0:23484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788744992.623979:0:24738:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788744992.623993:0:24738:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788744992.624109:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23493:x1875634419920000:12345-0@lo:7:osp-pre-0-1.0 Request processed in 22631us (25601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744992.624120:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788744992.624192:0:23493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bcf7dc00 x1875634419920000/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788745008 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744992.624209:0:23493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23493:1875634419920000:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788744992.624224:0:23493:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788744992.624288:0:23493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23493:1875634419920128:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788744992.624328:0:23493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744992.624366:0:23493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3bd5d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744992.624371:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419920128 00000100:00100000:3.0:1788744992.624379:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419920128 00000100:00100000:3.0:1788744992.624425:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744992.624435:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23493:x1875634419920128:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788744992.624460:0:24260:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788744992.624502:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23493:x1875634419920128:12345-0@lo:5:osp-pre-0-1.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744992.624510:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788744992.625836:0:23493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce2882f6680 x1875634419920128/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788745008 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744992.625853:0:23493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23493:1875634419920128:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788744992.625867:0:23493:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788744992.625907:0:23493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23493:1875634419920256:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788744992.625950:0:23493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744992.625987:0:23493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce281083840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744992.626023:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419920256 00000100:00100000:1.0:1788744992.626032:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419920256 00000100:00100000:1.0:1788744992.626084:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744992.626093:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23493:x1875634419920256:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788744992.626132:0:24738:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788744992.651293:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419919360:12345-0@lo:8:kworker.0 Request processed in 55338us (55785us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744992.651308:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1788744992.656849:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788744992.656869:0:24255:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788744992.657500:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23493:x1875634419920256:12345-0@lo:5:osp-pre-0-1.0 Request processed in 31402us (31543us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788744992.657511:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788744992.657607:0:23493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bcf7ed80 x1875634419920256/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788745008 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744992.657619:0:23493:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788744992.657626:0:23493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23493:1875634419920256:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788744992.657642:0:23493:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788744992.657697:0:23493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23493:1875634419920384:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788744992.657736:0:23493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744992.657768:0:23493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce383030600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744992.658407:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419920384 00000100:00100000:1.0:1788744992.658416:0:22762:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419920384 00000100:00100000:1.0:1788744992.658459:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744992.658469:0:22762:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23493:x1875634419920384:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788744992.658548:0:22762:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23493:x1875634419920384:12345-0@lo:900:osp-pre-0-1.0 Request processed in 80us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744992.658556:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788744992.658622:0:23493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bd50c700 x1875634419920384/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788745008 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744992.658636:0:23493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23493:1875634419920384:0@lo:900:osp-pre-0-1.0 00000100:00080000:2.0:1788744992.658801:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744992.658807:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744992.658811:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419919360:0@lo:8:kworker.0 00010000:00010000:3.0:1788744992.788424:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744992.848607:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419920512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788744992.848687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744992.848852:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419920512 00000100:00100000:0.0:1788744992.848862:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419920512 00000100:00100000:0.0:1788744992.848924:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744992.848935:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419920512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744992.848978:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744992.849039:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419920512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744992.849046:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744992.849172:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419920512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788744992.849832:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419920640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744992.849877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744992.850293:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419920640 00000100:00100000:1.0:1788744992.850301:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419920640 00000100:00100000:1.0:1788744992.850370:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744992.850380:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419920640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788744992.850409:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788744992.851356:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419920640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 975us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744992.851365:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744992.851492:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419920640:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788744993.809287:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744994.257194:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788744994.833306:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744995.877967:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744996.688367:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744976/real 1788744976] req@ffff9ce3a6bb3480 x1875634419910528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744996 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744996.688405:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3a6bb3480 x1875634419910528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744996 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744996.688417:0:3633:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744976/real 1788744976] req@ffff9ce3a6bb1f80 x1875634419910656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744996 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744996.688430:0:3633:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ce3a6bb1f80 x1875634419910656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744996 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744996.688466:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce287a2e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744996.688500:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788744996.688504:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419910528:0@lo:8:kworker.0 00000100:00080000:2.0:1788744996.688510:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744996.688516:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788744996.688519:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419910656:0@lo:8:kworker.0 00000100:00080000:3.0:1788744996.688719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744996.688724:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788744996.688727:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce287a2e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744996.688732:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:3.0:1788744996.688738:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788744996.688748:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ce287a2e800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744996.688770:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd50f800 x1875634419921024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744996.688771:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419920768:0@lo:400:kworker.0 00000100:00080000:3.0:1788744996.688785:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744996.688788:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788744996.688790:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744996.688793:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:3.0:1788744996.688796:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788744996.688807:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce392b85000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744996.688819:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd50e680 x1875634419921152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744996.688854:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744996.688857:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788744996.688858:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788744996.688860:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788744996.688861:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 717 00000100:00080000:3.0:1788744996.688864:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788744996.688868:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce3945f5000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1788744996.688877:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd50fb80 x1875634419921664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744996.688906:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419921536:0@lo:400:kworker.0 00000100:00100000:3.0:1788744996.688911:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875634419921280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.688932:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744996.688936:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744996.688952:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788744996.688953:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1875634419921920:0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.688957:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419920896:0@lo:400:kworker.0 00000100:00100000:3.0:1788744996.688974:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744996.688976:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744996.688990:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788744996.688990:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419921792:0@lo:400:kworker.0 00000100:00100000:3.0:1788744996.688994:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419921408:0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.689007:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744996.689009:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744996.689022:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419922048:0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.689032:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419920768 00000100:00100000:1.0:1788744996.689039:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419920768 00000100:00100000:3.0:1788744996.689042:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744996.689061:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419921280 00000100:00100000:3.0:1788744996.689065:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419921280 00000100:00100000:1.0:1788744996.689079:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788744996.689083:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419921920 00000100:00100000:3.0:1788744996.689086:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419921920 00000100:00100000:1.0:1788744996.689088:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:3634:x1875634419920768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744996.689104:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419921792 00000100:00100000:3.0:1788744996.689107:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419921792 00000100:00100000:3.0:1788744996.689124:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419922048 00000100:00100000:3.0:1788744996.689127:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419922048 00000100:00100000:1.0:1788744996.689140:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:3634:x1875634419920768:12345-0@lo:400:kworker.0 Request processed in 53us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744996.689141:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744996.689147:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875634419921280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.689147:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788744996.689177:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419921536 00000100:00100000:3.0:1788744996.689180:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875634419921280:12345-0@lo:400:kworker.0 Request processed in 33us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744996.689180:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419921536 00000100:00100000:3.0:1788744996.689185:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744996.689196:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744996.689202:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875634419921920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.689204:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744996.689209:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419921536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744996.689227:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875634419921920:12345-0@lo:400:kworker.0 Request processed in 25us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744996.689228:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419921536:12345-0@lo:400:kworker.0 Request processed in 21us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744996.689233:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744996.689234:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744996.689261:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744996.689279:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419921792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.689281:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419920896 00000100:00100000:1.0:1788744996.689285:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419920896 00000100:00100000:1.0:1788744996.689306:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419921408 00000100:00100000:3.0:1788744996.689307:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419921792:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744996.689309:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419921408 00000100:00100000:3.0:1788744996.689313:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744996.689324:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744996.689324:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744996.689329:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419922048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.689330:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419920896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744996.689354:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419922048:12345-0@lo:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744996.689354:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419920896:12345-0@lo:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744996.689360:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744996.689361:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744996.689371:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744996.689377:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419921408:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788744996.689404:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bd50ca80 x1875634419922048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744996.689417:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419922048:0@lo:400:kworker.0 00000100:00100000:2.0:1788744996.690418:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419921024:0@lo:8:kworker.0 00000100:00100000:1.0:1788744996.691620:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419921408:12345-0@lo:400:kworker.0 Request processed in 2236us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744996.691636:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788744996.691695:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744996.691701:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788744996.691704:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744996.691756:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419920896:0@lo:400:kworker.0 00010000:00080000:1.0:1788744996.691776:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bd50f100 x1875634419921792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788744996.694281:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bd50f480 x1875634419921280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744996.694299:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875634419921280:0@lo:400:kworker.0 00010000:00080000:3.0:1788744996.694317:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bd50df80 x1875634419921920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744996.694326:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1875634419921920:0@lo:400:kworker.0 00000100:00100000:3.0:1788744996.694366:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419921408:0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.697893:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419921792:0@lo:400:kworker.0 00010000:00080000:1.0:1788744996.697946:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bd50e300 x1875634419921536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788745012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744996.697959:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419921536:0@lo:400:kworker.0 00000100:00100000:1.0:1788744996.697972:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419920768:0@lo:400:kworker.0 00000100:00100000:2.0:1788744996.698500:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744996.698562:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419921152:0@lo:8:kworker.0 00000100:00100000:2.0:1788744996.698606:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744996.698627:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419921664:0@lo:8:kworker.0 00000100:00100000:2.0:1788744996.698646:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744996.698684:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419921024 00000100:00100000:2.0:1788744996.698690:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419921024 00000100:00100000:2.0:1788744996.698725:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419921152 00000100:00100000:2.0:1788744996.698728:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419921152 00000100:00100000:2.0:1788744996.698736:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419921664 00000100:00100000:2.0:1788744996.698738:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419921664 00000100:00100000:2.0:1788744996.698750:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744996.698757:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3633:x1875634419921024:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788744996.699147:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744996.699154:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419921152:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788744996.699168:0:24258:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788744996.699215:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419921152:12345-0@lo:8:kworker.0 Request processed in 60us (607us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744996.699222:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744996.699241:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744996.699262:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419921664:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788744996.699283:0:24258:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788744996.699306:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419921664:12345-0@lo:8:kworker.0 Request processed in 43us (659us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744996.699312:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788744996.699893:0:24261:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 721 last 0 00000020:00000080:2.0:1788744996.699926:0:24261:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6e465a23bbc29ee5 00002000:00100000:2.0:1788744996.699940:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ce3bd205000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788744996.699944:0:24261:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788744996.699953:0:24261:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788744996.700024:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788744996.700051:0:24261:0:(import.c:65:import_set_state_nolock()) ffff9ce3bd200800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744996.700098:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1875634419921024:12345-0@lo:8:kworker.0 Request processed in 1340us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744996.700105:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788744996.700149:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bd50f800 x1875634419921024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744996.700160:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744996.700167:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788744996.700175:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788744996.700180:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788744996.700183:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce287a2e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788744996.700209:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788744996.700214:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419921024:0@lo:8:kworker.0 00000100:00080000:2.0:1788744996.700227:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744996.700232:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744996.700235:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419921152:0@lo:8:kworker.0 00000100:00080000:2.0:1788744996.700257:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744996.700261:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744996.700272:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419921664:0@lo:8:kworker.0 00000004:00080000:3.0:1788744996.700342:0:22775:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788744996.700363:0:22775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22775:1875634419922304:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788744996.700394:0:22775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744996.700420:0:22775:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a6d46f00 going to sleep for 11 seconds 00000004:00080000:3.0:1788744996.700436:0:22774:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788744996.700499:0:22774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721643253318ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788744996.700505:0:22774:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788744996.700893:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744996.700902:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419922176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744996.700935:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744996.700960:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419922304 00000100:00100000:3.0:1788744996.700968:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419922304 00000100:00100000:2.0:1788744996.700972:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419922176 00000100:00100000:2.0:1788744996.700974:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419922176 00000100:00100000:3.0:1788744996.701009:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744996.701009:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744996.701017:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:22775:x1875634419922304:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788744996.701017:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875634419922176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744996.701041:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788744996.701079:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875634419922176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744996.701085:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788744996.701113:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3a6bb3480 x1875634419922176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788745012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744996.701128:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419922176:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788744996.702336:0:24258:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788744996.702345:0:24258:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788744996.702351:0:24258:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00080000:0.0:1788744996.713768:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788744996.714575:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.714588:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744996.715600:0:22730:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788744996.715838:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.715908:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.715918:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.715941:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.715953:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.715961:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.715995:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744996.716368:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.716375:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.716384:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.716388:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.716392:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.716401:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.716409:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.716417:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.716433:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788744996.716822:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.716828:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.716836:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.716960:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.716965:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.716975:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.716983:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.717736:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.717750:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788744996.718104:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.718110:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718121:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.718125:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.718129:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718140:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718148:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718160:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718168:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788744996.718444:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.718450:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718458:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.718461:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.718465:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718474:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718482:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718490:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718497:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788744996.718798:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.718804:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718817:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.718820:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.718824:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718833:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718946:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718955:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.718964:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788744996.719168:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.719173:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719181:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.719184:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.719188:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719197:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719214:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719222:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719230:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788744996.719419:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788744996.719428:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719436:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce381490a00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.719440:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719449:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719469:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719476:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddf6601c/0x6e465a23bbc29eec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719508:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788744996.719512:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719518:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce381490800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.719521:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719529:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719539:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719547:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006157eb18/0x6e465a23bbc29ef3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719559:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788744996.719563:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719569:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce381490e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.719572:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719589:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744996.719599:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788744996.719600:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719604:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719607:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000672f1102/0x6e465a23bbc29efa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719620:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788744996.719622:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1788744996.719623:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719626:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.719630:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719630:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce381491000 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.719634:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719642:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719651:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719658:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be28d57/0x6e465a23bbc29f01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719682:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788744996.719686:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719692:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921a00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.719695:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719700:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719703:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719713:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719720:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29f08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719732:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744996.719735:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719742:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.719745:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719764:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719774:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719780:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719781:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29f0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719788:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.719807:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788744996.719857:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744996.719861:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719867:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920200 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.719870:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719879:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719889:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719897:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29f16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719918:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744996.719921:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719928:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.719931:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719939:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719949:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719956:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29f1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.719968:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744996.719970:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744996.719972:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.720050:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.720092:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.720097:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720105:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.720107:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.720111:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720118:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720126:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720133:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720153:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744996.720484:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.720489:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720497:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.720504:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.720508:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720516:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720524:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720532:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720547:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788744996.720554:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744996.720558:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720565:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921600 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788744996.720568:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720575:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720585:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720601:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720811:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744996.720814:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720821:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920000 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788744996.720824:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720831:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720841:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720904:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.720919:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.720921:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.720922:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.721286:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.721292:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721306:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.721309:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.721313:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721322:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721329:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721336:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721349:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744996.721356:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744996.721359:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721366:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788744996.721369:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721376:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721397:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721404:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.721417:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.721418:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.721420:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.722140:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.722147:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.722158:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.722161:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.722165:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.722174:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.722181:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.722187:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.722220:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744996.722901:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744996.722909:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.722919:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920600 already unused, calling callback (ffffffffc0b888d0) 00002000:00010000:3.0:1788744996.723897:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.723905:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.723917:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.723921:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.723927:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.723938:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.723947:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.723954:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.723955:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.723971:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744996.723975:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744996.726062:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.726068:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.726070:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744996.726459:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744996.726469:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726485:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1788744996.726490:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744996.726496:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726511:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726521:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726528:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726546:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744996.726759:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726768:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921000 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.726772:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726804:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726822:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726830:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29f40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726850:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.726854:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726860:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7000 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.726862:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726869:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726878:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.726884:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d18f39/0x6e465a23bbc29f47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.727875:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.727887:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.727900:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.727907:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.727930:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744996.727933:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744996.727935:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.728295:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.728296:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.728298:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.731089:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.732879:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.732892:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.732917:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.732921:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.732927:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.732941:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.732950:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.732957:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.732973:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744996.735678:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744996.735691:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.735705:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920000 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788744996.735710:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.735722:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.735744:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.735764:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c06e052/0x6e465a23bbc29f4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744996.735801:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744996.735803:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744996.735805:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744996.740572:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744996.740584:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740599:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1788744996.740603:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744996.740611:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740627:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740636:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740644:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740664:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744996.740870:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.740877:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740896:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf6c00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.740901:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740909:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740925:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740932:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da4d5cbe/0x6e465a23bbc29f55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.740949:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.740951:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.740953:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.741624:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.741633:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.741827:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.741832:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.741837:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.741909:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.741932:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.741939:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.741962:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744996.742361:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.742370:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744996.742376:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744996.742380:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788744996.742381:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.742384:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.742390:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.742393:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744996.742394:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.742397:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.742407:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.742413:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.742414:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.742423:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.742423:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d24b256b/0x6e465a23bbc29f5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.742439:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.742440:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.742447:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744996.742972:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.742980:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.742990:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.742994:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.742997:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.743008:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.743016:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.743024:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.754911:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744996.754927:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.754942:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921600 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.754947:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.754959:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.754986:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.754995:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc29f63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.756352:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744996.757140:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788744996.757141:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744996.757150:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757150:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757161:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920a00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788744996.757165:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1788744996.757166:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757175:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744996.757176:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757182:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757191:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757193:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757200:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc29f6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757203:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757210:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757213:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.757215:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.757217:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.757228:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744996.757235:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.757239:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757260:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920400 already unused, calling callback (ffffffffc0b888d0) 00002000:00010000:3.0:1788744996.757505:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.757511:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757520:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.757523:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.757526:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757534:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757542:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757557:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.757566:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744996.757885:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757895:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757906:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757914:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278efbfc/0x6e465a23bbc29f71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757929:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.757932:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757939:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921200 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.757942:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757950:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757960:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757967:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035982b63/0x6e465a23bbc29f78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.757985:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.757987:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.757989:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.758045:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.758052:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758060:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.758063:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.758067:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758076:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758083:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758089:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758110:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744996.758494:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.758501:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758515:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.758518:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.758522:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758531:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758539:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758546:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.758554:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744996.759449:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744996.759460:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759471:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920c00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.759475:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759486:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759502:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759509:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f663d93/0x6e465a23bbc29f7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759528:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.759532:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759538:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921c00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.759549:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759556:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759566:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759573:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc29f86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.759586:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.759588:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.759590:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.760424:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.760578:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.760587:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.760599:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.760603:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.761059:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.761075:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.761097:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.761105:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.761125:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744996.761990:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.761999:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762012:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.762017:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.762022:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762032:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762041:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762049:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762073:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744996.762429:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744996.762437:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762445:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.762449:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762458:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762475:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762489:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc2ba98/0x6e465a23bbc29f8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762508:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.762512:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762519:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.762522:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762529:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762538:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762545:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007724e6f1/0x6e465a23bbc29f94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.762557:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.762559:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.762560:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.762569:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.762828:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.762834:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762955:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.762960:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.762965:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762975:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762985:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.762992:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.763012:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744996.764006:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.764015:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.764025:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.764035:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.764039:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.764050:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.764058:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.764066:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.764080:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744996.764390:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744996.764397:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764412:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920600 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.764416:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764424:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764438:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764445:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004be264a2/0x6e465a23bbc29f9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764463:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.764467:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764473:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921000 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.764476:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764483:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764493:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744996.764499:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.764504:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764507:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002593efa4/0x6e465a23bbc29fa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.764513:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.764516:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.764520:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764521:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.764522:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.764524:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.764528:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764531:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.764536:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.764548:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.764569:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744996.764597:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.764601:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764608:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.764612:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764620:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764630:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764637:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8282547/0x6e465a23bbc29fa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.764649:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.764651:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.764657:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.764924:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.766322:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.766333:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.766345:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.766350:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.766354:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.766366:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.766375:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.766382:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.766403:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744996.767023:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.767038:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767048:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.767052:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.767056:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767065:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767073:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767080:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767098:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744996.767110:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744996.767117:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767125:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920200 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.767129:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767137:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767152:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767159:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028221ff/0x6e465a23bbc29fb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767205:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744996.767209:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767216:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788744996.767219:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767228:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767282:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767291:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048146948/0x6e465a23bbc29fb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744996.767307:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.767309:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744996.767311:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744996.767404:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788744996.767410:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767417:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788744996.767420:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744996.767423:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767432:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767445:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767452:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767466:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744996.767473:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744996.767476:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767483:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921a00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788744996.767486:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767493:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767504:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767510:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aa0ce67/0x6e465a23bbc29fbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744996.767522:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.767528:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744996.767530:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788744996.767569:0:24258:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:3.0:1788744996.767939:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22775:x1875634419922304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 66919us (67541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744996.767949:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744996.768009:0:22775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22775:1875634419922304:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788744996.768025:0:22775:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788744996.768074:0:22775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22775:1875634419922432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788744996.768105:0:22775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744996.768126:0:22775:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744996.768140:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419922432 00000100:00100000:3.0:1788744996.768146:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419922432 00000100:00100000:3.0:1788744996.768181:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744996.768188:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22775:x1875634419922432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788744996.768222:0:24260:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:2.0:1788744996.773316:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788744996.775051:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788744996.775115:0:24255:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788744996.782082:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22775:x1875634419922432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13883us (13966us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788744996.782097:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744996.782505:0:22775:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788744996.782516:0:22775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22775:1875634419922432:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788744996.782533:0:22775:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1788744996.882099:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744997.911196:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744997.968479:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419922688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788744997.968567:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744997.968599:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419922560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788744997.968643:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744997.968694:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419922688 00000100:00100000:2.0:1788744997.968703:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419922688 00000100:00100000:2.0:1788744997.968769:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744997.968771:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419922816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788744997.968782:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419922688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788744997.968807:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788744997.968814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744997.968861:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419922688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744997.968869:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744997.968886:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419922560 00000100:00100000:0.0:1788744997.968891:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419922560 00000100:00100000:2.0:1788744997.968899:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419922816 00000100:00100000:2.0:1788744997.968904:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419922816 00000100:00100000:2.0:1788744997.968932:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744997.968938:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419922816:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788744997.969345:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744997.969355:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419922560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788744997.969380:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788744997.969480:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419922560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744997.969488:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00000024:2.0:1788744997.969500:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788744997.969573:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419922688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788744997.969651:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419922816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 712us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744997.969659:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744997.969742:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419922816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788744997.970676:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419922560:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788744998.930642:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744999.890964:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788744999.938029:0:25073:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788744999.938035:0:25073:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788744999.938037:0:25073:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788744999.938158:0:25073:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ce3bf870800 00000020:01000004:1.0:1788744999.938178:0:25073:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788744999.938199:0:25073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788744999.938229:0:25073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ce3bd043380) 00000020:00000080:1.0:1788744999.938375:0:25073:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788744999.952426:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788744999.980831:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788744999.983501:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788744999.983738:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788744999.984233:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788744999.984547:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788744999.984765:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788744999.985121:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788744999.986522:0:25073:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788744999.986756:0:25073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788744999.986772:0:25073:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744999.986843:0:25073:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6e465a23bbc29fcc 00000020:01000004:3.0:1788744999.986850:0:25073:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788744999.986874:0:25073:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.146@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788744999.986877:0:25073:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788744999.986884:0:25073:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788744999.986982:0:25073:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788744999.986987:0:25073:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788744999.997025:0:25073:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788744999.997136:0:25073:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.146@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788744999.997141:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788744999.997143:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744999.997144:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744999.997145:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744999.997146:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744999.997147:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744999.997148:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744999.997151:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744999.997152:0:25073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744999.997156:0:25073:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788744999.997159:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744999.997160:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744999.997161:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744999.997162:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744999.997163:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744999.997164:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744999.997165:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744999.997166:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744999.997168:0:25073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744999.997217:0:25073:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744999.997241:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419922944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744999.997410:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744999.997520:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a1f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744999.997565:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419922944 00000100:00100000:3.0:1788744999.997575:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419922944 00000100:00100000:3.0:1788744999.997651:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788744999.997662:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:25073:x1875634419922944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788744999.997707:0:22744:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788744999.997710:0:22744:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788744999.997715:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788744999.998505:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:25073:x1875634419922944:12345-0@lo:253:mount.lustre.0 Request processed in 842us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744999.998515:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788744999.998595:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419922944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744999.998607:0:25073:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788744999.998610:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744999.998612:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744999.998614:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744999.998624:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744999.998626:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744999.998627:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744999.998628:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744999.998630:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744999.998630:0:25073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744999.998652:0:25073:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ce3bf870800 from lustre-OST0001 10000000:01000000:2.0:1788744999.998685:0:25073:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788744999.998688:0:25073:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788744999.998698:0:25073:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ce38fe919c0 local copy 00010000:00010000:2.0:1788744999.998709:0:25073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744999.998819:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744999.998854:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744999.998891:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a1fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744999.999396:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419923072 00000100:00100000:1.0:1788744999.999404:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419923072 00000100:00100000:1.0:1788744999.999458:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788744999.999468:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:25073:x1875634419923072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744999.999565:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:25073:x1875634419923072:12345-0@lo:501:mount.lustre.0 Request processed in 99us (710us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744999.999573:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744999.999687:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788744999.999704:0:25073:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788744999.999725:0:25073:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788744999.999732:0:25073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744999.999742:0:25073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce381491800/0x6e465a23bbc29c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29c0d expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744999.999771:0:25073:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ce3bf870800 10000000:01000000:2.0:1788744999.999776:0:25073:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744999.999781:0:25073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788744999.999784:0:25073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744999.999798:0:25073:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788744999.999801:0:25073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788744999.999837:0:25073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3800/0x6e465a23bbc29fd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744999.999845:0:25073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3800/0x6e465a23bbc29fd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744999.999853:0:25073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3800/0x6e465a23bbc29fd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744999.999868:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744999.999901:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.000521:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a1fb40 going to sleep for 10 seconds 00000100:00100000:0.0:1788745000.000690:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419923200 00000100:00100000:0.0:1788745000.000698:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419923200 00000100:00100000:0.0:1788745000.000797:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788745000.000819:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:25073:x1875634419923200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788745000.000833:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745000.000846:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf6800/0x6e465a23bbc29fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29fd3 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.000872:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf6800/0x6e465a23bbc29fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29fd3 expref: 22 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.000882:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf6800/0x6e465a23bbc29fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29fd3 expref: 22 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.000890:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf6800, rc 0) 00000100:00100000:0.0:1788745000.000952:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923200:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.000958:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788745000.001094:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788745000.001111:0:25073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3800/0x6e465a23bbc29fd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29fda expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745000.001120:0:25073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3800/0x6e465a23bbc29fd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29fda expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788745000.004637:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788745000.006463:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788745000.009918:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788745000.009996:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788745000.010017:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788745000.010031:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788745000.010044:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788745000.010128:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788745000.010155:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788745000.010168:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788745000.010181:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788745000.010229:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788745000.010236:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788745000.010469:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788745000.010542:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.010651:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a1f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788745000.010703:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419923328 00000100:00100000:0.0:1788745000.010712:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419923328 00000100:00100000:0.0:1788745000.010894:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788745000.010905:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788745000.011083:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923328:12345-0@lo:501:mount.lustre.0 Request processed in 180us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.011091:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788745000.011165:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788745000.011199:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788745000.011276:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.011570:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a1f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.011656:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419923456 00000100:00100000:3.0:1788745000.011670:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419923456 00000100:00100000:3.0:1788745000.011695:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788745000.011702:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788745000.012676:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923456:12345-0@lo:503:mount.lustre.0 Request processed in 970us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.012685:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788745000.012782:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788745000.013362:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788745000.013444:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788745000.013499:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.013533:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a1fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.013598:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419923584 00000100:00100000:3.0:1788745000.013605:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419923584 00000100:00100000:3.0:1788745000.013633:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788745000.013641:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.014700:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923584:12345-0@lo:502:mount.lustre.0 Request processed in 1054us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.014711:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788745000.014884:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788745000.015421:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788745000.015459:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788745000.015476:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788745000.015491:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788745000.015506:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788745000.015518:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788745000.015531:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788745000.015544:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788745000.015559:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788745000.015594:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788745000.015645:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.015690:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a1fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788745000.015771:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419923712 00000100:00100000:0.0:1788745000.015779:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419923712 00000100:00100000:0.0:1788745000.015832:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788745000.015841:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788745000.015952:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923712:12345-0@lo:502:mount.lustre.0 Request processed in 112us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.015969:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788745000.016689:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788745000.016770:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788745000.016782:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788745000.017995:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788745000.018011:0:25077:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788745000.018018:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788745000.018021:0:25077:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788745000.018027:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788745000.018044:0:25077:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ce3bd040000) 00000020:00000080:1.0:1788745000.018145:0:25077:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788745000.018153:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788745000.018282:0:25077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce3bf870800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788745000.018293:0:25077:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788745000.018300:0:25077:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6e465a23bbc29fe8 00010000:00010000:0.0:1788745000.023165:0:25077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788745000.023709:0:25077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788745000.027589:0:25077:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788745000.029024:0:25077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788745000.029039:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788745000.029046:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788745000.029048:0:25077:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788745000.029052:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788745000.029188:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788745000.029191:0:25077:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788745000.029196:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788745000.029199:0:25077:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788745000.029201:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788745000.029204:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788745000.029214:0:25077:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788745000.029217:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788745000.029220:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788745000.029222:0:25077:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788745000.029225:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788745000.029279:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788745000.029283:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788745000.029284:0:25077:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788745000.029288:0:25077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788745000.031854:0:25073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788745000.031911:0:25073:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788745000.031975:0:25073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3800/0x6e465a23bbc29fd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29fda expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.031990:0:25073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3813f3800/0x6e465a23bbc29fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29fda expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788745000.031999:0:25073:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce3bf870800 from 1 10000000:01000000:3.0:1788745000.032002:0:25073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788745000.032043:0:25073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.032051:0:25073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.032089:0:25073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745000.032117:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788745000.032190:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.032270:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419840 going to sleep for 11 seconds 00000100:00100000:0.0:1788745000.033183:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419923840 00000100:00100000:0.0:1788745000.033194:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419923840 00000100:00100000:0.0:1788745000.033290:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788745000.033302:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:25073:x1875634419923840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788745000.033319:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745000.033335:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29fef expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.033362:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.033374:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.033384:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf6c00, rc 0) 00000100:00100000:0.0:1788745000.033453:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419923840:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.033460:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788745000.033615:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788745000.033634:0:25073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.033644:0:25073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788745000.035035:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788745000.035380:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788745000.035598:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788745000.035625:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788745000.035641:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788745000.035656:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788745000.035670:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788745000.035683:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788745000.035696:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788745000.035710:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788745000.035724:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788745000.035737:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788745000.035752:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788745000.035797:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788745000.035806:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788745000.035880:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788745000.035952:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.036001:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3bd5d19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788745000.037444:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419923968 00000100:00100000:2.0:1788745000.037456:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419923968 00000100:00100000:2.0:1788745000.037513:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788745000.037523:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419923968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788745000.037683:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419923968:12345-0@lo:501:mount.lustre.0 Request processed in 161us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745000.037691:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788745000.037976:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419923968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788745000.038024:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788745000.038132:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.038201:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3bd5d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788745000.041111:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419924096 00000100:00100000:1.0:1788745000.041127:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419924096 00000100:00100000:1.0:1788745000.041187:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788745000.041197:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419924096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788745000.041417:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419924096:12345-0@lo:503:mount.lustre.0 Request processed in 220us (3284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745000.041425:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788745000.041712:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788745000.042288:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788745000.042375:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.042434:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.042481:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3bd5d19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.042510:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419924224 00000100:00100000:3.0:1788745000.042518:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419924224 00000100:00100000:3.0:1788745000.042563:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788745000.042572:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419924224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.042669:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419924224:12345-0@lo:502:mount.lustre.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.042676:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788745000.042882:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788745000.043080:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788745000.043107:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788745000.043122:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788745000.043135:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788745000.043148:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788745000.043161:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788745000.043174:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788745000.043187:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788745000.043199:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788745000.043225:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788745000.043242:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788745000.043292:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788745000.043334:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.043366:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce286a1fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.043841:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419924352 00000100:00100000:3.0:1788745000.043848:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419924352 00000100:00100000:3.0:1788745000.043899:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788745000.043908:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419924352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.044006:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419924352:12345-0@lo:502:mount.lustre.0 Request processed in 99us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.044014:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788745000.044222:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788745000.044312:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788745000.044331:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788745000.045508:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788745000.045523:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788745000.045526:0:25081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788745000.045534:0:25081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce3bf870800 00000020:00000080:2.0:1788745000.045537:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788745000.045545:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788745000.045548:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788745000.045549:0:25081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788745000.045552:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788745000.045554:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788745000.045556:0:25081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788745000.045559:0:25081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ce3bf870800 00000020:00000080:2.0:1788745000.045561:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788745000.046851:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788745000.046959:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788745000.046963:0:25081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788745000.046968:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788745000.046973:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788745000.046975:0:25081:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788745000.046980:0:25081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce3bf870800 00000020:00000080:3.0:1788745000.046982:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788745000.048236:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788745000.048869:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788745000.048874:0:25081:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788745000.048881:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788745000.048885:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788745000.048886:0:25081:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788745000.048891:0:25081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ce3bf870800 00000020:00000080:3.0:1788745000.048894:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788745000.048976:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788745000.048980:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788745000.048982:0:25081:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788745000.048985:0:25081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788745000.057154:0:25073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788745000.057238:0:25073:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788745000.057273:0:25073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745000.057288:0:25073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788745000.058009:0:25073:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788745000.058014:0:25073:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ce3bf870800 10000000:01000000:3.0:1788745000.058018:0:25073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ce3bf870800 10000000:01000000:3.0:1788745000.058022:0:25073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788745000.058028:0:25073:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ce3bf870800 from 1 10000000:01000000:3.0:1788745000.058031:0:25073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788745000.058888:0:25073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.058901:0:25073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.058914:0:25073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745000.058951:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788745000.059031:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.059910:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419924480 00000100:00100000:3.0:1788745000.059920:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419924480 00000100:00100000:3.0:1788745000.059977:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788745000.059986:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:25073:x1875634419924480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788745000.060004:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745000.060019:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce287920200/0x6e465a23bbc2a004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc29ffd expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.060045:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce287920200/0x6e465a23bbc2a004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc29ffd expref: 24 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.060276:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce287920200/0x6e465a23bbc2a004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29ffd expref: 24 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.060286:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce287920200, rc 0) 00000100:00100000:3.0:1788745000.060339:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924480:12345-0@lo:101:mount.lustre.0 Request processed in 354us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.060346:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788745000.060399:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3bd5d10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.060422:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788745000.060441:0:25073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a004 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.060449:0:25073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2a004 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788745000.065540:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788745000.068375:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788745000.068619:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788745000.068646:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788745000.068662:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788745000.068674:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788745000.068686:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788745000.068699:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788745000.068713:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788745000.068726:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788745000.068738:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788745000.068750:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788745000.068763:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788745000.068777:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788745000.068791:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788745000.068804:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788745000.068817:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788745000.068830:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788745000.068860:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788745000.068876:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788745000.068889:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788745000.068903:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788745000.068917:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788745000.068930:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788745000.068943:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788745000.068957:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788745000.068969:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788745000.068981:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788745000.068995:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788745000.069009:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788745000.069023:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788745000.069051:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788745000.069068:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788745000.069082:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788745000.069109:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788745000.069125:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788745000.069139:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788745000.069155:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788745000.069169:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788745000.069181:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788745000.069194:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788745000.069220:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788745000.069237:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788745000.069276:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788745000.069290:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788745000.069304:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788745000.069316:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788745000.069328:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788745000.069342:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788745000.069356:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788745000.069490:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788745000.069509:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788745000.069527:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788745000.069532:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788745000.069631:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788745000.069701:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.069760:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419924608 00000100:00100000:3.0:1788745000.069767:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419924608 00000100:00100000:3.0:1788745000.069810:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788745000.069819:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788745000.069935:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924608:12345-0@lo:501:mount.lustre.0 Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.069951:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788745000.070000:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.070020:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788745000.070048:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788745000.070082:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.070102:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419924736 00000100:00100000:3.0:1788745000.070105:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419924736 00000100:00100000:3.0:1788745000.070124:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788745000.070129:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788745000.070189:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924736:12345-0@lo:503:mount.lustre.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.070196:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788745000.070235:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.070265:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924736:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788745000.070554:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788745000.070602:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.070633:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.070654:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419924864 00000100:00100000:3.0:1788745000.070658:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419924864 00000100:00100000:3.0:1788745000.070678:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788745000.070684:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.070741:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924864:12345-0@lo:502:mount.lustre.0 Request processed in 56us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.070748:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788745000.070777:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.070789:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788745000.070933:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788745000.070957:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788745000.070972:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788745000.070985:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788745000.070998:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788745000.071011:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788745000.071025:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788745000.071038:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788745000.071052:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788745000.071065:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788745000.071092:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788745000.071109:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788745000.071124:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788745000.071139:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788745000.071151:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788745000.071163:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788745000.071174:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788745000.071185:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788745000.071195:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788745000.077192:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788745000.078199:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788745000.078239:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788745000.078273:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788745000.078291:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788745000.078306:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788745000.078321:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788745000.078360:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788745000.078376:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788745000.078389:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788745000.078401:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788745000.078427:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788745000.078443:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788745000.078459:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788745000.078473:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788745000.078488:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788745000.078501:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788745000.078514:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788745000.078525:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788745000.078537:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788745000.078551:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788745000.078566:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788745000.078581:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788745000.078609:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788745000.078625:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788745000.078640:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788745000.078653:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788745000.078667:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788745000.078682:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788745000.078747:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.080010:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.080881:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419924992 00000100:00100000:3.0:1788745000.080892:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419924992 00000100:00100000:3.0:1788745000.080943:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788745000.080952:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.081319:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419924992:12345-0@lo:502:mount.lustre.0 Request processed in 367us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.081327:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788745000.081390:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.081416:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419924992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788745000.081641:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788745000.081670:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788745000.081706:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419925120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.081754:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745000.082754:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419925120 00000100:00100000:3.0:1788745000.082763:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419925120 00000100:00100000:3.0:1788745000.082815:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788745000.082825:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419925120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788745000.082936:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419925120:12345-0@lo:502:mount.lustre.0 Request processed in 113us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.082945:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788745000.083000:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38946f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.083020:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419925120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788745000.083083:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788745000.083096:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788745000.093599:0:25086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788745000.093626:0:25086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ce38f824d40) 00000020:00000080:1.0:1788745000.093656:0:25086:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788745000.093769:0:25086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce3bf870800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788745000.093774:0:25086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce3bf870800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788745000.093777:0:25086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3bf870800 3 00010000:00080000:1.0:1788745000.093879:0:25086:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce281996000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.146@tcp at head 00010000:00010000:1.0:1788745000.099399:0:25086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788745000.099619:0:25086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788745000.099671:0:25086:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788745000.099687:0:25086:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6e465a23bbc2a012 00000100:00080000:1.0:1788745000.099698:0:25086:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788745000.099711:0:25086:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ce281996000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788745000.099755:0:25086:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce2882f6a00 x1875634419925248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788745000.099872:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1875634419925248:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788745000.099947:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788745000.100946:0:25086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788745000.101482:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419925248 00000100:00100000:2.0:1788745000.101492:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419925248 00000100:00100000:2.0:1788745000.101534:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788745000.101543:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419925248:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788745000.101573:0:22750:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:2.0:1788745000.101609:0:22750:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6e465a23bbc2a019 00000004:00100000:2.0:1788745000.101626:0:22750:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788745000.101658:0:22750:0:(import.c:65:import_set_state_nolock()) ffff9ce39468a800 : changing import state from RECOVER to FULL 00000020:01000004:1.0:1788745000.102383:0:25086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788745000.102403:0:25086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ce38f8219c0) 00000020:00000080:1.0:1788745000.102424:0:25086:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788745000.102512:0:25086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ce3bf870800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788745000.102516:0:25086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ce3bf870800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788745000.102518:0:25086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ce3bf870800 3 00010000:00080000:1.0:1788745000.102545:0:25086:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9ce281997000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.146@tcp at head 00010000:00010000:1.0:1788745000.104136:0:25086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788745000.104385:0:25086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788745000.104436:0:25086:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788745000.104450:0:25086:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6e465a23bbc2a027 00000100:00080000:1.0:1788745000.104459:0:25086:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788745000.104471:0:25086:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ce281997000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788745000.104509:0:25086:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce2882f6680 x1875634419925376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788745000.105038:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1875634419925376:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788745000.107227:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.107399:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875634419925248:12345-0@lo:38:llog_process_th.0 Request processed in 5853us (7449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745000.107410:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788745000.107437:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419925376 00000100:00100000:2.0:1788745000.107444:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419925376 00000100:00100000:2.0:1788745000.107464:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788745000.107469:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1875634419925376:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788745000.107495:0:22750:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:2.0:1788745000.107527:0:22750:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6e465a23bbc2a02e 00000004:00100000:2.0:1788745000.107541:0:22750:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788745000.107572:0:22750:0:(import.c:65:import_set_state_nolock()) ffff9ce394688000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788745000.107613:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875634419925376:12345-0@lo:38:llog_process_th.0 Request processed in 144us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745000.107619:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788745000.107704:0:25086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788745000.111141:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00080000:3.0:1788745000.111290:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce2882f6a00 x1875634419925248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788745010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788745000.111304:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788745000.111316:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788745000.111325:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788745000.111331:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788745000.111342:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce281996000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788745000.111351:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1875634419925248:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788745000.111388:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce2882f6680 x1875634419925376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788745010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788745000.111396:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788745000.111400:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788745000.111406:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788745000.111409:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788745000.111411:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce281997000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788745000.111415:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1875634419925376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788745000.113146:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419925632:0@lo:400:kworker.0 00000100:00100000:2.0:1788745000.113222:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.113280:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419925504:0@lo:400:kworker.0 00000100:00100000:2.0:1788745000.113339:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745000.113432:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419925632 00000100:00100000:1.0:1788745000.113440:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419925632 00000100:00100000:1.0:1788745000.113502:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788745000.113519:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419925632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745000.113587:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419925632:12345-0@lo:400:kworker.0 Request processed in 76us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745000.113594:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788745000.113619:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788745000.113728:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419925632:0@lo:400:kworker.0 00000100:00080000:0.0:1788745000.113927:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788745000.113933:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788745000.113937:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788745000.113942:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 721 00000100:00080000:0.0:1788745000.113947:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788745000.113968:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce392b85000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1788745000.113999:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bcf7ed80 x1875634419925760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788745000.114161:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419925760:0@lo:8:kworker.0 00000100:00100000:3.0:1788745000.114195:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788745000.115024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788745000.115029:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788745000.115032:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788745000.115037:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 721 00000100:00080000:0.0:1788745000.115040:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788745000.115048:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce3945f5000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788745000.115172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419926016:0@lo:400:kworker.0 00000100:00100000:1.0:1788745000.115279:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745000.115308:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788745000.115315:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875634419925888:0@lo:400:kworker.0 00000100:00100000:1.0:1788745000.115340:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745000.115376:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419925504 00000100:00100000:1.0:1788745000.115384:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419925504 00000100:00100000:1.0:1788745000.115424:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419926016 00000100:00100000:1.0:1788745000.115428:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419926016 00000100:00100000:1.0:1788745000.115443:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788745000.115452:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419925504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745000.115519:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419925504:12345-0@lo:400:kworker.0 Request processed in 68us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745000.115532:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788745000.115547:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788745000.115553:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419926016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745000.115588:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419926016:12345-0@lo:400:kworker.0 Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745000.115594:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788745000.115613:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419925888 00000100:00100000:1.0:1788745000.115617:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419925888 00000100:00100000:1.0:1788745000.115646:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788745000.115653:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875634419925888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745000.115684:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875634419925888:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745000.115690:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788745000.115730:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3bcf7dc00 x1875634419925888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745000.115743:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875634419925888:0@lo:400:kworker.0 00000100:00100000:1.0:1788745000.115754:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419926016:0@lo:400:kworker.0 00000100:00100000:0.0:1788745000.115889:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3c1907b80 x1875634419926272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788745000.115956:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419926144:0@lo:400:kworker.0 00000100:00100000:0.0:1788745000.115987:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745000.116012:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788745000.116018:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419926400:0@lo:400:kworker.0 00000100:00100000:0.0:1788745000.116038:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745000.116193:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419925760 00000100:00100000:2.0:1788745000.116198:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419925760 00000100:00100000:2.0:1788745000.116230:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419926144 00000100:00100000:2.0:1788745000.116234:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419926144 00000100:00100000:2.0:1788745000.116357:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788745000.116365:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419926144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788745000.116403:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419926144:12345-0@lo:400:kworker.0 Request processed in 40us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745000.116417:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788745000.116432:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788745000.116437:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419925760:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788745000.116481:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419925760:12345-0@lo:8:kworker.0 Request processed in 43us (2286us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788745000.116486:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788745000.116553:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1875634419926528:0@lo:400:kworker.0 00000100:00100000:0.0:1788745000.116579:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745000.116606:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788745000.116611:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419926656:0@lo:400:kworker.0 00000100:00100000:0.0:1788745000.116635:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745000.116668:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419925504:0@lo:400:kworker.0 00000100:00100000:0.0:1788745000.116690:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419926400 00000100:00100000:0.0:1788745000.116693:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419926400 00000100:00100000:0.0:1788745000.116711:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419926528 00000100:00100000:0.0:1788745000.116719:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419926528 00000100:00100000:0.0:1788745000.116733:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419926656 00000100:00100000:0.0:1788745000.116735:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419926656 00000100:00100000:0.0:1788745000.116748:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788745000.116753:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419926400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788745000.117157:0:22750:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788745000.117166:0:22750:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788745000.118871:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419926400:12345-0@lo:400:kworker.0 Request processed in 31us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.118886:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788745000.118924:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788745000.118939:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875634419926528:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788745000.119240:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788745000.119263:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788745000.119266:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788745000.119292:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419926272:0@lo:8:kworker.0 00000100:00100000:1.0:1788745000.119332:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745000.119392:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788745000.119400:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788745000.119404:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788745000.119412:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419925760:0@lo:8:kworker.0 00000100:00100000:1.0:1788745000.119440:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419926272 00000100:00100000:1.0:1788745000.119445:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419926272 00000100:00100000:1.0:1788745000.119469:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788745000.119474:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419926272:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788745000.119519:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3633:x1875634419926272:12345-0@lo:8:kworker.0 Request processed in 45us (187us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788745000.119525:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788745000.119545:0:3633:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788745000.119548:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788745000.119551:0:3633:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788745000.119554:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419926272:0@lo:8:kworker.0 00000100:00100000:0.0:1788745000.119615:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875634419926528:12345-0@lo:400:kworker.0 Request processed in 124us (2475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.119622:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788745000.119636:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788745000.119644:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419926656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745000.119678:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419926656:12345-0@lo:400:kworker.0 Request processed in 37us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.119683:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788745000.119714:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3c1905f80 x1875634419926400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788745000.119725:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419926400:0@lo:400:kworker.0 00000100:00100000:0.0:1788745000.119734:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419926144:0@lo:400:kworker.0 00010000:00080000:0.0:1788745000.119760:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3c1907800 x1875634419926656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788745000.119770:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419926656:0@lo:400:kworker.0 00010000:00080000:0.0:1788745000.120140:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ce3c1904380 x1875634419926528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788745000.120150:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1875634419926528:0@lo:400:kworker.0 00000040:00080000:2.0:1788745000.126112:0:25086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788745000.126372:0:25073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788745000.126408:0:25073:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788745000.126433:0:25073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a004 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.126447:0:25073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce287921a00/0x6e465a23bbc29ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a004 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788745000.126509:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788745000.126512:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788745000.126513:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788745000.126515:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788745000.126516:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788745000.126517:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788745000.126519:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788745000.126521:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788745000.126523:0:25073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788745000.126527:0:25073:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788745000.126529:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788745000.126530:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788745000.126531:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788745000.126532:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788745000.126534:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788745000.126535:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788745000.126536:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788745000.126537:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788745000.126538:0:25073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788745000.126566:0:25073:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788745000.126589:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1904380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419926784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788745000.126665:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745000.126730:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a6df9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.132229:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419926784 00000100:00100000:3.0:1788745000.132267:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419926784 00000100:00100000:3.0:1788745000.132326:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788745000.132338:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419926784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788745000.132375:0:22745:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788745000.132394:0:22745:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788745000.142849:0:22745:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788745000.142872:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788745000.143305:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:25073:x1875634419926784:12345-0@lo:253:mount.lustre.0 Request processed in 10965us (16634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.143317:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788745000.143458:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1904380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:25073:1875634419926784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788745000.143472:0:25073:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788745000.143475:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788745000.143477:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788745000.143478:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788745000.143479:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788745000.143481:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788745000.143482:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788745000.143483:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788745000.143485:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788745000.143487:0:25073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788745000.143505:0:25073:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788745000.144796:0:22766:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788745000.144803:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788745000.144825:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.144841:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.144849:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.144855:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.144892:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.144905:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 23 pid: 22742 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745000.144929:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419926912:0@lo:104: 00000100:00100000:1.0:1788745000.144991:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788745000.145037:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.145046:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 23 pid: 22744 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745000.145065:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419927040:0@lo:104: 00000100:00100000:1.0:1788745000.145089:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745000.145110:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a6945000 going to sleep for 11 seconds 00000100:00100000:3.0:1788745000.145568:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419926912 00000100:00100000:3.0:1788745000.145576:0:22733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419926912 00000100:00100000:3.0:1788745000.145610:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419927040 00000100:00100000:3.0:1788745000.145621:0:22733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419927040 00000100:00100000:3.0:1788745000.145641:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788745000.145650:0:22733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:22766:x1875634419926912:12345-0@lo:104: 00010000:00010000:3.0:1788745000.145664:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.145728:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788745000.145735:0:22733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:22766:x1875634419926912:12345-0@lo:104: Request processed in 85us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.145744:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788745000.145764:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788745000.145770:0:22733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:22766:x1875634419927040:12345-0@lo:104: 00010000:00010000:3.0:1788745000.145777:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.145824:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788745000.145829:0:22733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:22766:x1875634419927040:12345-0@lo:104: Request processed in 61us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745000.145835:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788745000.145852:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788745000.145858:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.145865:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7a00 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:3.0:1788745000.145869:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.145877:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788745000.145895:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788745000.145901:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788745000.145932:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.145939:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788745000.145970:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.145977:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7a00/0x6e465a23bbc29ed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ed7 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.145991:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745000.145994:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.146000:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7200 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:3.0:1788745000.146002:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.146008:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788745000.146014:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788745000.146019:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788745000.146042:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.146048:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788745000.146066:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.146073:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc29ec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ec9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745000.146088:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745000.146090:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745000.146092:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745000.146098:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788745000.146805:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419927168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788745000.146855:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745000.146902:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788745000.146909:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419927296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788745000.146933:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745000.146990:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419927168 00000100:00100000:0.0:1788745000.146996:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419927168 00010000:00010000:0.0:1788745000.147019:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 24 pid: 22742 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745000.147040:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419927296 00000100:00100000:0.0:1788745000.147043:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419927296 00010000:00010000:0.0:1788745000.147054:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 25 pid: 22744 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745000.147068:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788745000.147075:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1907800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+25:3634:x1875634419927168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788745000.147085:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788745000.147091:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 25 pid: 22742 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147101:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 25 pid: 22742 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147120:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788745000.147153:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1907800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+25:3634:x1875634419927168:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.147159:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788745000.147176:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788745000.147191:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1906300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3634:x1875634419927296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788745000.147199:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788745000.147214:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 24 pid: 22744 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147224:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 24 pid: 22744 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147236:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147268:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788745000.147285:0:22735:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010286024s 00010000:00010000:0.0:1788745000.147290:0:22735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147296:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147303:0:22735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147309:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147314:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3b403fe00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788745000.147318:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147335:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147345:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745000.147355:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788745000.147381:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1906300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3634:x1875634419927296:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745000.147387:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788745000.147422:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419927296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788745000.147429:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419927168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788745000.148454:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3b403e200/0x6e465a23bbc29ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29ed0 expref: 23 pid: 22742 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745000.148469:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419926912:0@lo:104: 00010000:00010000:1.0:1788745000.148480:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce381490400/0x6e465a23bbc29ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29ec2 expref: 22 pid: 22744 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745000.148489:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875634419927040:0@lo:104: 00010000:00010000:1.0:1788745000.148516:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.148525:0:22766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.148531:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745000.148549:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3b403fe00/0x6e465a23bbc2a035 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788745000.150711:0:25073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788745000.161837:0:25073:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788745000.161847:0:25073:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788745000.161890:0:25073:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788745000.161935:0:25073:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788745000.161956:0:25073:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788745000.161975:0:25073:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788745000.168588:0:25073:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788745000.168888:0:25073:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788745000.978306:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788745001.470282:0:25142:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788745001.472513:0:25142:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788745002.002672:0:22747:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788745002.002683:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3bda7d000 from 14 10000000:01000000:3.0:1788745002.002689:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788745002.002754:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921000/0x6e465a23bbc2a03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745002.002768:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce287921000/0x6e465a23bbc2a03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745002.002779:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce287921000/0x6e465a23bbc2a03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745002.002826:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419927424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788745002.002907:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745002.002997:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce287760780 going to sleep for 11 seconds 00000100:00100000:0.0:1788745002.003002:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419927424 00000100:00100000:0.0:1788745002.003013:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419927424 00000100:00100000:0.0:1788745002.003083:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788745002.003094:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:22747:x1875634419927424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788745002.003111:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745002.003126:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc2a043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc2a03c expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745002.003151:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc2a043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc2a03c expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745002.003162:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf6a00/0x6e465a23bbc2a043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc2a03c expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745002.003180:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf6a00, rc 0) 00000100:00100000:0.0:1788745002.003272:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419927424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745002.003280:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788745002.003400:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419927424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788745002.003418:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce287921000/0x6e465a23bbc2a03c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a043 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745002.003428:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce287921000/0x6e465a23bbc2a03c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2a043 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745002.003486:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419927552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788745002.003520:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745002.003543:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a6945540 going to sleep for 11 seconds 00010000:00010000:0.0:1788745002.003612:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788745002.006289:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419927552 00000100:00100000:3.0:1788745002.006304:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419927552 00000100:00100000:3.0:1788745002.006367:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788745002.006377:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419927552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788745002.006402:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788745002.006420:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788745002.006424:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788745002.006557:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419927552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745002.006565:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788745002.007144:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419927552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788745002.007293:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788745002.007304:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce287921000/0x6e465a23bbc2a03c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a043 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745002.007315:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce287921000/0x6e465a23bbc2a03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a043 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788745002.007326:0:22747:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788745002.007329:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ce3ba964000 from 14 10000000:01000000:1.0:1788745002.007333:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788745002.007363:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e600/0x6e465a23bbc2a04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745002.007377:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e600/0x6e465a23bbc2a04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745002.007388:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e600/0x6e465a23bbc2a04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745002.007409:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419927680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788745002.007470:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745002.007758:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a6945540 going to sleep for 11 seconds 00000100:00100000:0.0:1788745002.010369:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419927680 00000100:00100000:0.0:1788745002.010388:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419927680 00000100:00100000:1.0:1788745002.010509:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788745002.010519:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419927680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788745002.010537:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788745002.010556:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3b403fc00/0x6e465a23bbc2a051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc2a04a expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745002.010583:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3b403fc00/0x6e465a23bbc2a051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc2a04a expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745002.010594:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3b403fc00/0x6e465a23bbc2a051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc2a04a expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745002.010604:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403fc00, rc 0) 00000100:00100000:1.0:1788745002.010682:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:22747:x1875634419927680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745002.010689:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788745002.010928:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419927680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788745002.010946:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e600/0x6e465a23bbc2a04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a051 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745002.010956:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e600/0x6e465a23bbc2a04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2a051 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745002.011031:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419927808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788745002.011072:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745002.011111:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce281083780 going to sleep for 11 seconds 00000100:00100000:0.0:1788745002.011159:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419927808 00000100:00100000:0.0:1788745002.011165:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419927808 00000100:00100000:0.0:1788745002.011207:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788745002.011214:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:22747:x1875634419927808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788745002.011229:0:22742:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788745002.011274:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788745002.011278:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788745002.011354:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:22747:x1875634419927808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745002.011361:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788745002.011581:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419927808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788745002.011635:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788745002.011642:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e600/0x6e465a23bbc2a04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a051 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745002.011650:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e600/0x6e465a23bbc2a04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a051 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745002.064542:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419927936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788745002.064635:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745002.064771:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419927936 00000100:00100000:2.0:1788745002.064781:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419927936 00000100:00100000:2.0:1788745002.064855:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788745002.064867:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419927936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788745002.064901:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788745002.064959:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419927936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745002.064966:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788745002.065033:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788745002.065297:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3a6bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419927936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788745003.041236:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745003.093425:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419928064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788745003.093548:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745003.093610:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419928064 00000100:00100000:1.0:1788745003.093618:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419928064 00000100:00100000:1.0:1788745003.093674:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788745003.093682:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419928064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788745003.093705:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788745003.093745:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419928064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745003.093752:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788745003.093773:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788745003.098503:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419928064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788745003.098600:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788745003.098612:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419928192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788745003.098672:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745003.098710:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419928192 00000100:00100000:1.0:1788745003.098716:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419928192 00000100:00100000:1.0:1788745003.098758:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788745003.098768:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419928192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788745003.098803:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788745003.098861:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419928192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745003.098868:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788745003.099148:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419928192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788745003.101409:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788745003.101442:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419928320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788745003.101504:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745003.101551:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419928320 00000100:00100000:0.0:1788745003.101558:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419928320 00000100:00100000:0.0:1788745003.101596:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788745003.101605:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419928320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788745003.101650:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788745003.101701:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419928320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745003.101708:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788745003.101748:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419928320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788745004.048359:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788745004.561104:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788745005.073833:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788745005.140381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788745005.140388:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788745005.140391:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788745005.140392:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419928704:0@lo:400:kworker.0 00000100:00080000:1.0:1788745005.140406:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ce392b85000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788745005.140433:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bcf7dc00 x1875634419928832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788745005.140459:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788745005.140465:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788745005.140468:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788745005.140469:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788745005.140475:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ce3945f5000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1788745005.140485:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ce3bd4c3800 x1875634419929344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788745005.140496:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788745005.140502:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419929472:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.140561:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419928448:0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.140575:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745005.140595:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419928960:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.140595:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745005.140614:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745005.140627:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419929088:0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.140629:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419929984:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.140649:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745005.140651:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745005.140664:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419929728:0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.140665:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788745005.140669:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1875634419929600:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.140681:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745005.140697:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419929472 00000100:00100000:1.0:1788745005.140699:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788745005.140703:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419928576:0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.140705:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419929472 00000100:00100000:1.0:1788745005.140722:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745005.140737:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419929216:0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.140754:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419928960 00000100:00100000:1.0:1788745005.140755:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745005.140757:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419928960 00000100:00100000:3.0:1788745005.140769:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419929984 00000100:00100000:1.0:1788745005.140769:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1875634419929856:0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.140771:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419929984 00000100:00100000:1.0:1788745005.140791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745005.140793:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419929728 00000100:00100000:3.0:1788745005.140796:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419929728 00000100:00100000:3.0:1788745005.140809:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419929856 00000100:00100000:3.0:1788745005.140811:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419929856 00000100:00100000:1.0:1788745005.140814:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419928832:0@lo:8:kworker.0 00000100:00100000:3.0:1788745005.140827:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788745005.140832:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745005.140835:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419929472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.140847:0:3633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419929344:0@lo:8:kworker.0 00000100:00100000:1.0:1788745005.140870:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745005.140876:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419929472:12345-0@lo:400:kworker.0 Request processed in 42us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745005.140883:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788745005.140895:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419928704 00000100:00100000:3.0:1788745005.140898:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788745005.140898:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419928704 00000100:00100000:3.0:1788745005.140903:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419928960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.140916:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419929216 00000100:00100000:1.0:1788745005.140919:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419929216 00000100:00100000:3.0:1788745005.140928:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419928960:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745005.140934:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788745005.140935:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419928832 00000100:00100000:1.0:1788745005.140937:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419928832 00000100:00100000:3.0:1788745005.140944:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788745005.140944:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419929344 00000100:00100000:1.0:1788745005.140946:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419929344 00000100:00100000:3.0:1788745005.140949:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875634419929984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.140954:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788745005.140959:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419928704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.140972:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875634419929984:12345-0@lo:400:kworker.0 Request processed in 23us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745005.140977:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788745005.140981:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419928704:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745005.140986:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788745005.140993:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788745005.140994:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788745005.140998:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419929728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.140999:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419929216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.141024:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419929216:12345-0@lo:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745005.141030:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788745005.141042:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788745005.141045:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1875634419928832:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788745005.141074:0:24738:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 730 last 0 00000100:00100000:0.0:1788745005.141079:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788745005.141087:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875634419929856:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1788745005.141107:0:24738:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6e465a23bbc2a058 00002000:00100000:1.0:1788745005.141134:0:24738:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ce281993800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788745005.141139:0:24738:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788745005.141142:0:24738:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788745005.141240:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419929728:12345-0@lo:400:kworker.0 Request processed in 240us (557us total) trans 0 rc 0/0 00002000:00080000:1.0:1788745005.143667:0:24738:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788745005.143771:0:24738:0:(import.c:65:import_set_state_nolock()) ffff9ce281995800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788745005.143875:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3633:x1875634419928832:12345-0@lo:8:kworker.0 Request processed in 2826us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745005.143885:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788745005.143919:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788745005.143925:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1875634419929344:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788745005.143965:0:24738:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 730 last 0 00000020:00000080:1.0:1788745005.143991:0:24738:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6e465a23bbc2a05f 00002000:00100000:1.0:1788745005.144004:0:24738:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ce281992000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788745005.144009:0:24738:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788745005.144011:0:24738:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788745005.144076:0:24738:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788745005.144088:0:24738:0:(import.c:65:import_set_state_nolock()) ffff9ce281991800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788745005.144114:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3633:x1875634419929344:12345-0@lo:8:kworker.0 Request processed in 189us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745005.145268:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788745005.145316:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419928448 00000100:00100000:1.0:1788745005.145328:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419928448 00000100:00100000:1.0:1788745005.145380:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788745005.145388:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3636:x1875634419928448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.145454:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3636:x1875634419928448:12345-0@lo:400:kworker.0 Request processed in 66us (4857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745005.145461:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788745005.145493:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419929088 00000100:00100000:1.0:1788745005.145497:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419929088 00000100:00100000:1.0:1788745005.145570:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419928576 00000100:00100000:1.0:1788745005.145573:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419928576 00000100:00100000:1.0:1788745005.145603:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788745005.145609:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419929088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.145625:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788745005.145642:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419929088:12345-0@lo:400:kworker.0 Request processed in 34us (4993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745005.145648:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788745005.145658:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788745005.145663:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419928576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745005.145722:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875634419929856:12345-0@lo:400:kworker.0 Request processed in 4633us (4926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745005.145730:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788745005.145986:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419928576:12345-0@lo:400:kworker.0 Request processed in 32us (4971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745005.145994:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788745005.146027:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788745005.146034:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788745005.146037:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788745005.146109:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3bcf7dc00 x1875634419928832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788745030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788745005.146139:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788745005.146148:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788745005.146154:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788745005.146157:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce392b85000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788745005.146184:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788745005.146190:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1875634419928832:0@lo:8:kworker.0 00010000:00080000:1.0:1788745005.146205:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3bd4c3800 x1875634419929344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788745030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788745005.146215:0:3633:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788745005.146219:0:3633:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788745005.146222:0:3633:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788745005.146229:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ce3945f5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788745005.146273:0:23494:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788745005.146353:0:23494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 730089107451ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788745005.146359:0:23494:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788745005.146403:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788745005.146409:0:3633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1875634419929344:0@lo:8:kworker.0 00000004:00080000:1.0:1788745005.146464:0:23495:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788745005.146484:0:23495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23495:1875634419930240:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788745005.146518:0:23495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745005.146539:0:23495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3afa01840 going to sleep for 11 seconds 00000100:00100000:1.0:1788745005.146551:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419930112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788745005.146574:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745005.146602:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419930112 00000100:00100000:1.0:1788745005.146606:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419930112 00000100:00100000:1.0:1788745005.146637:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788745005.146646:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875634419930112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788745005.146664:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000004:00080000:3.0:1788745005.148057:0:22777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788745005.148077:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22777:1875634419930496:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788745005.148079:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875634419930112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1434us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745005.148087:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788745005.148110:0:22777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788745005.148130:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788745005.148143:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce391dc6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788745005.148143:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419930240 00000100:00100000:1.0:1788745005.148148:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419930240 00000004:00080000:3.0:1788745005.148156:0:22776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788745005.148175:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419930496 00000100:00100000:1.0:1788745005.148178:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419930496 00000100:00100000:1.0:1788745005.148198:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788745005.148206:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23495:x1875634419930240:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788745005.148221:0:22776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 730090976092ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788745005.148227:0:22776:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788745005.148516:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788745005.148524:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22777:x1875634419930496:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788745005.148562:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788745005.148595:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288292a00 x1875634419930112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745005.148612:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419930112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788745005.148636:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419930368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788745005.148662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745005.148706:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419928576:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.148718:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419929216:0@lo:400:kworker.0 00010000:00080000:1.0:1788745005.148730:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288290a80 x1875634419929856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745005.148737:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1875634419929856:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.148747:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419928448:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.148758:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419929088:0@lo:400:kworker.0 00010000:00080000:1.0:1788745005.148768:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288293480 x1875634419929728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745005.148776:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419929728:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.148808:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788745005.148842:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288292300 x1875634419929984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788745005.149935:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419930368 00000100:00100000:3.0:1788745005.149946:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419930368 00000100:00100000:3.0:1788745005.150001:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788745005.150010:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875634419930368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788745005.150030:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788745005.150106:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875634419930368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745005.150112:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788745005.151126:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419929600 00000100:00100000:3.0:1788745005.151137:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419929600 00000100:00100000:3.0:1788745005.151190:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788745005.151199:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875634419929600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745005.151274:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875634419929600:12345-0@lo:400:kworker.0 Request processed in 76us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745005.151281:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788745005.152170:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419929984:0@lo:400:kworker.0 00010000:00080000:1.0:1788745005.152203:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288291f80 x1875634419929472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745005.152212:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419929472:0@lo:400:kworker.0 00010000:00080000:1.0:1788745005.152241:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3bcf7ed80 x1875634419928960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745005.152265:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419928960:0@lo:400:kworker.0 00000100:00100000:1.0:1788745005.152288:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419928704:0@lo:400:kworker.0 00010000:00080000:1.0:1788745005.152321:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288291500 x1875634419929600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745005.152329:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1875634419929600:0@lo:400:kworker.0 00000100:00080000:1.0:1788745005.152374:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788745005.152823:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3bd50f800 x1875634419930368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788745021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745005.152843:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419930368:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788745005.154977:0:23484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788745005.157532:0:24258:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788745005.157542:0:24258:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788745005.157644:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23495:x1875634419930240:12345-0@lo:7:osp-pre-1-1.0 Request processed in 9435us (11121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745005.157655:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788745005.157771:0:23495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288291c00 x1875634419930240/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788745021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788745005.157788:0:23495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23495:1875634419930240:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788745005.157805:0:23495:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788745005.157845:0:23495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1906d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23495:1875634419930624:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788745005.157880:0:23495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745005.157903:0:23495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388b88180 going to sleep for 11 seconds 00000100:00100000:0.0:1788745005.157920:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419930624 00000100:00100000:0.0:1788745005.157926:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419930624 00000100:00100000:0.0:1788745005.157963:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788745005.157971:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23495:x1875634419930624:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788745005.160136:0:24260:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788745005.160227:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23495:x1875634419930624:12345-0@lo:5:osp-pre-1-1.0 Request processed in 2254us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745005.160261:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788745005.160327:0:23495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3c1906d80 x1875634419930624/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788745021 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788745005.160340:0:23495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1906d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23495:1875634419930624:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788745005.160352:0:23495:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788745005.160392:0:23495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1906d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23495:1875634419930752:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788745005.160423:0:23495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745005.160449:0:23495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388b88180 going to sleep for 11 seconds 00000100:00100000:0.0:1788745005.160469:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419930752 00000100:00100000:0.0:1788745005.160475:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419930752 00000100:00100000:0.0:1788745005.160511:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788745005.160521:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23495:x1875634419930752:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788745005.160548:0:24258:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:3.0:1788745005.163418:0:24261:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788745005.163430:0:24261:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1788745005.163437:0:24261:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00002000:00010000:3.0:1788745005.183698:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.183711:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.183736:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.183742:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.183749:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.183769:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.183782:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.183791:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.183821:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788745005.183966:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788745005.183975:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.183985:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:1.0:1788745005.183990:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.184001:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.184021:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.184038:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a066 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.184056:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745005.184058:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745005.184059:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788745005.185390:0:22730:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788745005.185751:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.185761:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.185777:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.185782:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.185788:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.185802:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.185813:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.185822:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.185845:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788745005.186833:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.186841:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.186853:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.186856:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.186860:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.186884:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.186893:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.186900:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.186977:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788745005.187671:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.187679:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.187692:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.187755:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.187761:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.187774:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.187783:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.187805:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.187825:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788745005.188874:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.188884:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.188899:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.188903:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.188907:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.188931:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.188941:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.188950:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191208:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788745005.191227:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191256:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920600 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:1.0:1788745005.191262:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191278:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191303:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191311:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a06d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191333:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788745005.191337:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191351:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:1.0:1788745005.191354:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191361:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191371:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191377:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a074 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191390:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788745005.191394:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191400:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:1.0:1788745005.191403:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191411:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191420:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191432:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a07b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191444:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788745005.191447:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191454:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921c00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:1.0:1788745005.191456:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191463:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191473:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745005.191480:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745005.191482:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745005.191484:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745005.191496:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.195307:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.200828:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788745005.200844:0:24261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a082 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.201239:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788745005.201704:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788745005.201713:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.201740:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1788745005.201745:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788745005.201752:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.201767:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.201778:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.201785:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.201809:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.201976:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.201983:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.201992:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f2e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.201997:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.202009:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.202030:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.202038:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a089 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.202054:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.202056:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.202058:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788745005.203277:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788745005.203287:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203301:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1788745005.203305:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788745005.203311:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203322:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203343:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203352:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203378:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.203412:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.203420:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.203430:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f3400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.203443:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.203453:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.203470:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.203478:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a090 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.203497:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.203499:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.203501:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788745005.203795:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788745005.203801:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203810:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1788745005.203813:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788745005.203817:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203825:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203833:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203840:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.203959:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.203998:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.204004:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.204013:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f2400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.204017:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.204026:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.204037:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.204051:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a097 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.204065:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.204067:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.204069:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788745005.204215:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788745005.204222:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204230:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1788745005.204233:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788745005.204237:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204267:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204276:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204285:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204304:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788745005.204331:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788745005.204336:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204343:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce381490400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745005.204353:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204361:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204372:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204380:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084d30640/0x6e465a23bbc2a09e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.204394:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.204396:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.204398:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.205057:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.205066:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205089:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.205094:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.205099:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205111:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205128:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205137:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205155:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.205164:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.205175:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205183:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920c00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.205186:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205194:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205208:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205215:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.205231:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.205233:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.205235:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.206588:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.206599:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.206614:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.206618:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.206624:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.206652:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.206663:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.206671:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.206693:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788745005.208795:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788745005.208809:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.208823:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921c00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745005.208827:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.208838:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.208872:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.208890:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a71ea08/0x6e465a23bbc2a0ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.208909:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.208910:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.208912:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.209154:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.209165:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.209178:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.209183:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.209189:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.209203:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.209212:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.209234:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.211839:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.212824:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.212835:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.212848:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921200 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.212853:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.212865:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.212888:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.212897:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a0b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.212929:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.212931:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.212933:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.213225:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.213241:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.213275:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.213280:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.213286:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.213299:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.214028:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.214041:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.214066:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788745005.214828:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.214835:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.214849:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.214853:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.214858:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.214871:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.214886:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.214895:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.214908:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788745005.215225:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.215231:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215239:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.215267:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.215272:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215282:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215290:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215297:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215331:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788745005.215341:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788745005.215347:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215355:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.215359:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215369:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215382:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215389:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000278efbfc/0x6e465a23bbc2a0ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215413:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788745005.215417:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215424:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920a00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.215427:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215445:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215454:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215462:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084001f69/0x6e465a23bbc2a0c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215472:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.215475:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215581:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921600 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.215587:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215596:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215606:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215613:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de899d25/0x6e465a23bbc2a0c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215636:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.215637:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.215639:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.215979:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.215985:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.215994:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.215997:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.216001:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216010:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216018:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216026:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216040:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.216045:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.216049:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216065:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.216068:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216190:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216205:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216211:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d24b256b/0x6e465a23bbc2a0cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216225:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.216227:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.216228:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.216606:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.216612:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216622:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.216625:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.216629:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216637:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216651:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216658:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216671:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.216678:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.216682:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216689:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920000 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.216826:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216837:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216848:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216855:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c06e052/0x6e465a23bbc2a0d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.216868:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.216874:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.216876:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.217640:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.217648:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217659:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.217662:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.217667:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217677:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217685:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217703:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217718:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.217725:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.217730:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217737:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.217741:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217760:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217772:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217780:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc2ba98/0x6e465a23bbc2a0dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.217797:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.217798:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.217800:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.217817:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.217826:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.218294:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.218301:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.218379:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.218382:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.218387:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.218470:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.218478:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.218502:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.218524:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788745005.219140:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788745005.219148:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219158:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745005.219162:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219171:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219185:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219191:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007724e6f1/0x6e465a23bbc2a0e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219211:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.219221:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.219222:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.219806:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.219815:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.219827:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.219832:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.219837:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.219849:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.219857:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.219864:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.219891:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788745005.219901:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788745005.219907:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219917:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920c00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745005.219920:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219928:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219938:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219945:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f663d93/0x6e465a23bbc2a0eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.219959:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.219961:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.219962:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.220635:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.220643:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.220662:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.220666:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.220671:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.220682:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.220693:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.220959:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.220984:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788745005.221012:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788745005.221019:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.221027:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920600 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745005.221031:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.221047:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.221059:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.221066:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004be264a2/0x6e465a23bbc2a0f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.221082:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.221084:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.221086:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.221578:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.221585:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221595:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.221599:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.221604:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221617:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221639:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221649:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221669:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788745005.221678:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.221684:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221805:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.221811:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221821:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221835:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221842:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8282547/0x6e465a23bbc2a0f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.221856:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.221863:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.221864:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.222528:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.222535:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.222545:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.222548:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.222552:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.222562:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.222571:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.222579:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.222598:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788745005.223007:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.223014:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.223023:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.223025:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.223029:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.223045:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.223054:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.223060:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.223074:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788745005.223798:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788745005.223807:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223817:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f2400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745005.223822:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223830:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223844:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223861:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6fb883/0x6e465a23bbc2a100 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223880:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788745005.223883:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223889:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f3400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745005.223891:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223899:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223910:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223917:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff52af4/0x6e465a23bbc2a107 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745005.223928:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.223929:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.223931:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745005.223937:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.224778:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.224788:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.224802:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.224807:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.224814:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.224829:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.224839:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.224860:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.224887:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788745005.224935:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788745005.224943:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.224950:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f2e00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788745005.224953:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.224960:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.224974:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.224995:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d6c7dac/0x6e465a23bbc2a10e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.225010:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.225011:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.225013:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.226293:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.226302:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.226325:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.226329:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.226334:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.226345:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.226352:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.226359:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.226384:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788745005.226690:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788745005.226698:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.226706:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921200 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788745005.226710:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.226718:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.226733:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.226740:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035982b63/0x6e465a23bbc2a115 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.226915:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.226918:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.226919:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.227179:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.227186:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227201:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.227205:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.227210:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227220:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227228:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227234:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227274:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788745005.227284:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788745005.227291:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.227300:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33fe00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788745005.227305:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.227313:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.227325:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.227333:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095b8d566/0x6e465a23bbc2a11c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.227350:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.227351:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.227355:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.227809:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.227816:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227824:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.227828:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.227832:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227840:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227859:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227866:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.227898:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788745005.227931:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788745005.227938:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.227947:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33ec00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788745005.227950:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.227970:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.228187:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.228196:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b1b51b2/0x6e465a23bbc2a123 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.228212:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.228214:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.228216:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788745005.228385:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788745005.228393:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788745005.228435:0:25074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788745005.228469:0:25074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788745005.228475:0:25074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788745005.228618:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=730s v=(0 0) 00010000:00010000:3.0:1788745005.228621:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788745005.228627:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.228638:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.228647:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.228655:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.228688:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788745005.228821:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23495:x1875634419930752:12345-0@lo:5:osp-pre-1-1.0 Request processed in 68297us (68393us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788745005.228832:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788745005.229026:0:23495:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788745005.229034:0:23495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1906d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23495:1875634419930752:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788745005.229051:0:23495:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00002000:00010000:0.0:1788745005.229085:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788745005.229092:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229101:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1788745005.229105:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788745005.229110:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229129:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229146:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229153:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229168:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788745005.229169:0:23495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23495:1875634419930880:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1788745005.229178:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788745005.229184:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229191:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33f200 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788745005.229195:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229203:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745005.229215:0:23495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788745005.229215:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229226:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa994cf7/0x6e465a23bbc2a12a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745005.229276:0:23495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3be976000 going to sleep for 11 seconds 00010000:00010000:0.0:1788745005.229279:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788745005.229289:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229297:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7a00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788745005.229300:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745005.229303:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419930880 00010000:00010000:0.0:1788745005.229310:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229322:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745005.229324:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419930880 00010000:00010000:0.0:1788745005.229333:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa9e8ad1/0x6e465a23bbc2a131 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229350:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.229352:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.229354:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788745005.229370:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788745005.229379:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23495:x1875634419930880:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788745005.229641:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788745005.229648:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229656:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1788745005.229660:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788745005.229664:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745005.229752:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23495:x1875634419930880:12345-0@lo:900:osp-pre-1-1.0 Request processed in 373us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745005.229759:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788745005.229785:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229795:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788745005.229796:0:23495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3bd50f100 x1875634419930880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788745021 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788745005.229813:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745005.229818:0:23495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23495:1875634419930880:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1788745005.229832:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788745005.229841:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788745005.229846:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229853:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7200 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:0.0:1788745005.229856:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229863:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229873:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229880:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057c7bf7a/0x6e465a23bbc2a138 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.229900:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.229902:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745005.229904:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788745005.230289:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788745005.230295:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.230304:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1788745005.230307:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788745005.230311:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.230320:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.230328:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.230336:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745005.230358:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788745005.230541:0:24261:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1788745005.230582:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22777:x1875634419930496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 82059us (82471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745005.230589:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788745005.230712:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788745005.230718:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.230728:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7000 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745005.230732:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.230748:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.230762:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.230770:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d18f39/0x6e465a23bbc2a13f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745005.230786:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.230788:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788745005.230790:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788745005.230816:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22777:1875634419930496:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788745005.230828:0:22777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788745005.230861:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22777:1875634419931008:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788745005.230891:0:22777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745005.231867:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419931008 00000100:00100000:0.0:1788745005.231878:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419931008 00000100:00100000:0.0:1788745005.231924:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788745005.231932:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22777:x1875634419931008:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788745005.231968:0:24260:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1788745005.232341:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788745005.233425:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3be976000 going to sleep for 11 seconds 00000100:00100000:0.0:1788745005.239431:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22777:x1875634419931008:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7490us (8529us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788745005.239444:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788745005.241348:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22777:1875634419931008:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788745005.241393:0:22777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1788745006.096416:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745007.121690:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788745007.184478:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788745007.184503:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419931136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788745007.184577:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745007.184625:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419931136 00000100:00100000:0.0:1788745007.184633:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419931136 00000100:00100000:0.0:1788745007.184703:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788745007.184714:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419931136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788745007.184744:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788745007.184785:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419931136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745007.184805:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788745007.184827:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788745007.184862:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419931136:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788745007.700771:0:25432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788745008.144482:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788745008.209891:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788745008.209919:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419931264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788745008.210008:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745008.210077:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419931264 00000100:00100000:2.0:1788745008.210085:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419931264 00000100:00100000:2.0:1788745008.210155:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788745008.210166:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419931264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788745008.210189:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788745008.210234:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419931264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745008.210242:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788745008.210285:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788745008.210326:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419931264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788745008.215974:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788745008.216012:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419931520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788745008.216097:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745008.216160:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419931520 00000100:00100000:1.0:1788745008.216168:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419931520 00000100:00100000:1.0:1788745008.216221:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788745008.216230:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419931520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788745008.216364:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788745008.216417:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419931520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 187us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745008.216424:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788745008.216493:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419931520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788745008.217378:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419931392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788745008.217429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745008.218462:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419931392 00000100:00100000:1.0:1788745008.218473:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419931392 00000100:00100000:1.0:1788745008.218530:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788745008.218541:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419931392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788745008.218576:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788745008.218634:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419931392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745008.218642:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788745008.218971:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419931392:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788745008.857873:0:25485:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788745008.858645:0:25485:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788745009.109028:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788745009.168520:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788745009.915490:0:25535:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788745009.916098:0:25535:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788745010.192468:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745010.197298:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.197359:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396743936 00000100:00100000:3.0:1788745010.197375:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396743936 00000100:00100000:3.0:1788745010.197459:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 116 00000100:00100000:3.0:1788745010.197469:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2391:x1875634396743936:12345-192.168.201.46@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788745010.197510:0:22744:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 89bd4431-e5bd-4a95-a183-977432e8cc17@192.168.201.46@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:3.0:1788745010.197546:0:22744:0:(genops.c:1384:class_connect()) connect: client 89bd4431-e5bd-4a95-a183-977432e8cc17, cookie 0x6e465a23bbc2a146 00000100:00080000:3.0:1788745010.197729:0:22744:0:(import.c:65:import_set_state_nolock()) ffff9ce2859f6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788745010.197818:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+5:2391:x1875634396743936:12345-192.168.201.46@tcp:250:mount.lustre.0 Request processed in 349us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.197827:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 116 00000100:00100000:0.0:1788745010.200957:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745010.209429:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396744064 00000100:00100000:1.0:1788745010.209455:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396744064 00000100:00100000:1.0:1788745010.209556:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 117 00000100:00100000:1.0:1788745010.209571:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+5:18057:x1875634396744064:12345-192.168.201.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788745010.209620:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788745010.209644:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3b403e400/0x6e465a23bbc2a14d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421b23 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.209687:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3b403e400/0x6e465a23bbc2a14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b23 expref: 6 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.209701:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3b403e400/0x6e465a23bbc2a14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b23 expref: 6 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.209712:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403e400, rc 0) 00000100:00100000:1.0:1788745010.209807:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+6:18057:x1875634396744064:12345-192.168.201.46@tcp:101:mount.lustre.0 Request processed in 239us (8862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.209816:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 117 00000100:00100000:1.0:1788745010.217593:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.217691:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396744192 00000100:00100000:3.0:1788745010.217707:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396744192 00000100:00100000:3.0:1788745010.217787:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 118 00000100:00100000:3.0:1788745010.217802:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+6:18057:x1875634396744192:12345-192.168.201.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788745010.217993:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+6:18057:x1875634396744192:12345-192.168.201.46@tcp:501:mount.lustre.0 Request processed in 194us (415us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788745010.218003:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 118 00000100:00100000:1.0:1788745010.221438:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745010.221684:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396744320 00000100:00100000:0.0:1788745010.221706:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396744320 00000100:00100000:0.0:1788745010.221780:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 119 00000100:00100000:0.0:1788745010.221792:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+6:18057:x1875634396744320:12345-192.168.201.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788745010.221833:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745010.221858:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf7800/0x6e465a23bbc2a154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421b2a expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745010.221908:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf7800/0x6e465a23bbc2a154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b2a expref: 7 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745010.221922:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf7800/0x6e465a23bbc2a154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b2a expref: 7 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745010.221933:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf7800, rc 0) 00000100:00100000:0.0:1788745010.222013:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+7:18057:x1875634396744320:12345-192.168.201.46@tcp:101:mount.lustre.0 Request processed in 223us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745010.222021:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 119 00000100:00100000:0.0:1788745010.224443:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745010.224538:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396744448 00000100:00100000:1.0:1788745010.224551:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396744448 00000100:00100000:1.0:1788745010.224635:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 120 00000100:00100000:1.0:1788745010.224647:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+7:18057:x1875634396744448:12345-192.168.201.46@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788745010.224880:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18057:x1875634396744448:12345-192.168.201.46@tcp:501:mount.lustre.0 Request processed in 234us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.224897:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 120 00000100:00100000:2.0:1788745010.226736:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.226877:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396744576 00000100:00100000:3.0:1788745010.226889:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396744576 00000100:00100000:3.0:1788745010.226957:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 121 00000100:00100000:3.0:1788745010.226968:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18057:x1875634396744576:12345-192.168.201.46@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788745010.227164:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18057:x1875634396744576:12345-192.168.201.46@tcp:503:mount.lustre.0 Request processed in 197us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.227172:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 121 00000100:00100000:2.0:1788745010.233069:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745010.233239:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396744704 00000100:00100000:1.0:1788745010.233283:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396744704 00000100:00100000:1.0:1788745010.233362:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 122 00000100:00100000:1.0:1788745010.233375:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18075:x1875634396744704:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788745010.234041:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18075:x1875634396744704:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 657us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.234052:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 122 00000100:00100000:2.0:1788745010.256565:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788745010.256598:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419931648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788745010.256694:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745010.256827:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419931648 00000100:00100000:2.0:1788745010.256838:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419931648 00000100:00100000:2.0:1788745010.257083:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788745010.257097:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875634419931648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788745010.257141:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788745010.257195:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419931776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788745010.257198:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875634419931648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.257206:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788745010.257228:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788745010.257231:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788745010.257270:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419931776 00000100:00100000:2.0:1788745010.257275:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419931776 00000100:00100000:2.0:1788745010.257307:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788745010.257313:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419931776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788745010.257324:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788745010.257366:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419931776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.257373:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788745010.257387:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788745010.257428:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419931648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788745010.257702:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419931776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788745010.264784:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419932160:0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265019:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3635:1875634419931904:0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265116:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745010.265199:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419932416:0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265232:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745010.265295:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1875634419932928:0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265326:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745010.265359:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788745010.265367:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419932288:0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265394:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745010.265414:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419932800:0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745010.265482:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419932928 00000100:00100000:3.0:1788745010.265495:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419932928 00000100:00100000:3.0:1788745010.265572:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419932288 00000100:00100000:3.0:1788745010.265576:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419932288 00000100:00100000:3.0:1788745010.265592:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419932800 00000100:00100000:3.0:1788745010.265594:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419932800 00000100:00100000:3.0:1788745010.265612:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788745010.265621:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875634419932928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265690:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875634419932928:12345-0@lo:400:kworker.0 Request processed in 69us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.265698:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788745010.265719:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788745010.265725:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419932288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265750:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419932288:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.265778:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788745010.265789:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788745010.265795:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419932800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.265818:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419932800:12345-0@lo:400:kworker.0 Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.265823:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788745010.265851:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419931904 00000100:00100000:3.0:1788745010.265854:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419931904 00000100:00100000:3.0:1788745010.266280:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788745010.266288:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3635:x1875634419931904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.266331:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3635:x1875634419931904:12345-0@lo:400:kworker.0 Request processed in 44us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.266339:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1788745010.266401:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288290700 x1875634419932288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788745010.266419:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419932288:0@lo:400:kworker.0 00010000:00080000:3.0:1788745010.266431:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3be9d8a80 x1875634419932800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788745010.266440:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419932800:0@lo:400:kworker.0 00000100:00100000:3.0:1788745010.266449:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3635:1875634419931904:0@lo:400:kworker.0 00010000:00080000:3.0:1788745010.266458:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3be9d8700 x1875634419932928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788745010.266467:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1875634419932928:0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.266598:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745010.266643:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875634419932672:0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.266678:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745010.266687:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419932160 00000100:00100000:0.0:1788745010.266695:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419932160 00000100:00100000:1.0:1788745010.266706:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419933184:0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.266727:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745010.266737:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788745010.266745:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419932160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.266753:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788745010.266760:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419932032:0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.266786:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745010.266788:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419932160:12345-0@lo:400:kworker.0 Request processed in 45us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745010.266794:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788745010.266806:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419932544:0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.266829:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745010.266855:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419933056:0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.267041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745010.267064:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419932544 00000100:00100000:0.0:1788745010.267068:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419932544 00000100:00100000:1.0:1788745010.267076:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419932160:0@lo:400:kworker.0 00000100:00100000:0.0:1788745010.267098:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788745010.267100:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419932416 00000100:00100000:1.0:1788745010.267103:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419932416 00000100:00100000:0.0:1788745010.267110:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419932544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.267141:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419932032 00000100:00100000:1.0:1788745010.267144:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419932032 00000100:00100000:1.0:1788745010.267161:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788745010.267162:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419932544:12345-0@lo:400:kworker.0 Request processed in 52us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.267168:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419932416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745010.267177:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788745010.267210:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419932416:12345-0@lo:400:kworker.0 Request processed in 42us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.267217:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788745010.267231:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788745010.267238:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419932032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.267299:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419932032:12345-0@lo:400:kworker.0 Request processed in 63us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.267306:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788745010.267326:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419932672 00000100:00100000:1.0:1788745010.267330:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419932672 00000100:00100000:1.0:1788745010.267349:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419933184 00000100:00100000:1.0:1788745010.267351:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419933184 00000100:00100000:1.0:1788745010.267366:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419933056 00000100:00100000:1.0:1788745010.267369:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419933056 00000100:00100000:1.0:1788745010.267383:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788745010.267390:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875634419932672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.267421:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875634419932672:12345-0@lo:400:kworker.0 Request processed in 32us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.267427:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788745010.267438:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788745010.267445:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875634419933184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.267471:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875634419933184:12345-0@lo:400:kworker.0 Request processed in 28us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.267477:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788745010.267487:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788745010.267493:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875634419933056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.267517:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875634419933056:12345-0@lo:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.267522:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788745010.267556:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419932032:0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.267566:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419932544:0@lo:400:kworker.0 00010000:00080000:1.0:1788745010.267587:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3bd4c0a80 x1875634419933056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745010.267598:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419933056:0@lo:400:kworker.0 00010000:00080000:1.0:1788745010.267608:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3be9daa00 x1875634419932672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745010.267617:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3be9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875634419932672:0@lo:400:kworker.0 00010000:00080000:1.0:1788745010.267627:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3bd4c2a00 x1875634419933184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745010.267634:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1875634419933184:0@lo:400:kworker.0 00000100:00100000:1.0:1788745010.267695:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419932416:0@lo:400:kworker.0 00000100:00080000:2.0:1788745010.268011:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788745010.268018:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788745010.268021:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788745010.282402:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.282787:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396744832 00000100:00100000:3.0:1788745010.282801:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396744832 00000100:00100000:3.0:1788745010.282894:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 124 00000100:00100000:3.0:1788745010.282908:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18075:x1875634396744832:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788745010.283129:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18075:x1875634396744832:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 222us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.283138:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 124 00000100:00100000:0.0:1788745010.292399:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745010.292514:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396744960 00000100:00100000:2.0:1788745010.292529:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396744960 00000100:00100000:2.0:1788745010.292607:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 125 00000100:00100000:2.0:1788745010.292619:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18075:x1875634396744960:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788745010.292866:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18075:x1875634396744960:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 240us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.292892:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 125 00000100:00100000:2.0:1788745010.296779:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.297426:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396745088 00000100:00100000:3.0:1788745010.297441:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396745088 00000100:00100000:3.0:1788745010.297521:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 126 00000100:00100000:3.0:1788745010.297535:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ba931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+8:18057:x1875634396745088:12345-192.168.201.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788745010.297561:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745010.297586:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3bd33f600/0x6e465a23bbc2a15b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421b5b expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745010.297623:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3bd33f600/0x6e465a23bbc2a15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b5b expref: 9 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745010.297638:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3bd33f600/0x6e465a23bbc2a15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b5b expref: 9 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745010.297648:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33f600, rc 0) 00000100:00100000:3.0:1788745010.297746:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ba931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+9:18057:x1875634396745088:12345-192.168.201.46@tcp:101:mount.lustre.0 Request processed in 213us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.297754:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 126 00000100:00100000:3.0:1788745010.300396:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745010.300668:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396745216 00000100:00100000:0.0:1788745010.300682:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396745216 00000100:00100000:0.0:1788745010.300764:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 127 00000100:00100000:0.0:1788745010.300778:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ba930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+9:18057:x1875634396745216:12345-192.168.201.46@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788745010.300819:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788745010.300859:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788745010.300864:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788745010.300868:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788745010.300870:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788745010.300873:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788745010.315435:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ba930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+9:18057:x1875634396745216:12345-192.168.201.46@tcp:256:mount.lustre.0 Request processed in 14641us (15032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.315472:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 127 00000100:00100000:2.0:1788745010.322607:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745010.323053:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396745344 00000100:00100000:0.0:1788745010.323069:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396745344 00000100:00100000:0.0:1788745010.323360:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 128 00000100:00100000:2.0:1788745010.323455:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+9:18057:x1875634396745344:12345-192.168.201.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788745010.323481:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745010.323506:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421b62 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745010.323546:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 10 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745010.323560:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 10 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745010.323569:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce381490e00, rc 0) 00000100:00100000:2.0:1788745010.323806:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18057:x1875634396745344:12345-192.168.201.46@tcp:101:mount.lustre.0 Request processed in 435us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.323814:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 128 00000100:00100000:2.0:1788745010.335241:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.337596:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396745472 00000100:00100000:3.0:1788745010.337621:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396745472 00000100:00100000:3.0:1788745010.337726:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 129 00000100:00100000:3.0:1788745010.337741:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18057:x1875634396745472:12345-192.168.201.46@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788745010.338126:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18057:x1875634396745472:12345-192.168.201.46@tcp:501:mount.lustre.0 Request processed in 386us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.338135:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 129 00000100:00100000:0.0:1788745010.351048:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745010.351913:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396745600 00000100:00100000:2.0:1788745010.351941:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396745600 00000100:00100000:2.0:1788745010.352022:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 130 00000100:00100000:2.0:1788745010.352045:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18057:x1875634396745600:12345-192.168.201.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788745010.352415:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18057:x1875634396745600:12345-192.168.201.46@tcp:503:mount.lustre.0 Request processed in 372us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.352425:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 130 00000100:00100000:2.0:1788745010.358109:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745010.358308:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396745728 00000100:00100000:1.0:1788745010.358322:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396745728 00000100:00100000:1.0:1788745010.358407:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 131 00000100:00100000:1.0:1788745010.358419:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18082:x1875634396745728:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788745010.358615:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18082:x1875634396745728:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 188us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.358624:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 131 00000100:00100000:0.0:1788745010.370881:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.371283:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396745856 00000100:00100000:3.0:1788745010.371300:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396745856 00000100:00100000:3.0:1788745010.371381:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 132 00000100:00100000:3.0:1788745010.371395:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18082:x1875634396745856:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788745010.371897:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18082:x1875634396745856:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 504us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.371909:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 132 00000100:00100000:0.0:1788745010.393482:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745010.393612:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.394091:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396745984 00000100:00100000:3.0:1788745010.394106:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396745984 00000100:00100000:3.0:1788745010.394172:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396746240 00000100:00100000:3.0:1788745010.394176:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396746240 00000100:00100000:3.0:1788745010.394206:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00100000:3.0:1788745010.394413:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1875634396745984:12345-192.168.201.46@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788745010.394455:0:22751:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from d68d9106-f31a-4f98-bd1c-504f18088b76@192.168.201.46@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:3.0:1788745010.394526:0:22751:0:(genops.c:1384:class_connect()) connect: client d68d9106-f31a-4f98-bd1c-504f18088b76, cookie 0x6e465a23bbc2a169 00000004:00100000:3.0:1788745010.394557:0:22751:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788745010.394851:0:22751:0:(import.c:65:import_set_state_nolock()) ffff9ce2859f5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788745010.394978:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2391:x1875634396745984:12345-192.168.201.46@tcp:38:mount.lustre.0 Request processed in 566us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.400419:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8 00000100:00100000:2.0:1788745010.400444:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1875634396746240:12345-192.168.201.46@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788745010.400506:0:22752:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from d68d9106-f31a-4f98-bd1c-504f18088b76@192.168.201.46@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:2.0:1788745010.400580:0:22752:0:(genops.c:1384:class_connect()) connect: client d68d9106-f31a-4f98-bd1c-504f18088b76, cookie 0x6e465a23bbc2a170 00000004:00100000:2.0:1788745010.401044:0:22752:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788745010.401373:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00080000:2.0:1788745010.401910:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9ce3be835000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788745010.402005:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2391:x1875634396746240:12345-192.168.201.46@tcp:38:mount.lustre.0 Request processed in 1566us (8392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.402016:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8 00000100:00100000:2.0:1788745010.417721:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745010.417764:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745010.417802:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.417896:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396746496 00000100:00100000:3.0:1788745010.417909:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396746496 00000100:00100000:3.0:1788745010.417990:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396746368 00000100:00100000:3.0:1788745010.417994:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396746368 00000100:00100000:3.0:1788745010.418023:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396746112 00000100:00100000:3.0:1788745010.418035:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396746112 00000100:00100000:3.0:1788745010.418053:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 9 00000100:00100000:3.0:1788745010.418064:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18057:x1875634396746496:12345-192.168.201.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788745010.418130:0:22751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788745010.418282:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18057:x1875634396746496:12345-192.168.201.46@tcp:41:mount.lustre.0 Request processed in 218us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.418290:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 9 00000100:00100000:3.0:1788745010.418311:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10 00000100:00100000:3.0:1788745010.418317:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:0:x1875634396746368:12345-192.168.201.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788745010.418337:0:22751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788745010.418373:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:0:x1875634396746368:12345-192.168.201.46@tcp:41:mount.lustre.0 Request processed in 57us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.418379:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10 00000100:00100000:3.0:1788745010.418390:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 11 00000100:00100000:3.0:1788745010.418396:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:0:x1875634396746112:12345-192.168.201.46@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788745010.418405:0:22751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788745010.418421:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:0:x1875634396746112:12345-192.168.201.46@tcp:41:mount.lustre.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.418448:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 11 00000100:00080000:2.0:1788745010.419133:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788745010.419140:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788745010.424810:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.425999:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396746624 00000100:00100000:3.0:1788745010.426033:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396746624 00000100:00100000:3.0:1788745010.426118:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 12 00000100:00100000:3.0:1788745010.426131:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18057:x1875634396746624:12345-192.168.201.46@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788745010.426356:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18057:x1875634396746624:12345-192.168.201.46@tcp:40:mount.lustre.0 Request processed in 225us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745010.426365:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 12 00000100:00100000:0.0:1788745010.437547:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745010.437792:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396746752 00000100:00100000:2.0:1788745010.437806:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396746752 00000100:00100000:2.0:1788745010.437871:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 19 00000100:00100000:2.0:1788745010.437882:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1875634396746752:12345-192.168.201.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788745010.437931:0:24258:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from d68d9106-f31a-4f98-bd1c-504f18088b76@192.168.201.46@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:2.0:1788745010.437976:0:24258:0:(genops.c:1384:class_connect()) connect: client d68d9106-f31a-4f98-bd1c-504f18088b76, cookie 0x6e465a23bbc2a177 00002000:00100000:2.0:1788745010.437993:0:24258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d68d9106-f31a-4f98-bd1c-504f18088b76/ffff9ce3be832000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788745010.438040:0:24258:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788745010.438356:0:24258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788745010.438719:0:24258:0:(import.c:65:import_set_state_nolock()) ffff9ce3be836000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788745010.438840:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2391:x1875634396746752:12345-192.168.201.46@tcp:8:mount.lustre.0 Request processed in 956us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745010.438879:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 19 00000100:00100000:2.0:1788745010.439525:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745010.439706:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745010.439813:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396746880 00000100:00100000:0.0:1788745010.439827:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396746880 00000100:00100000:0.0:1788745010.439874:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 20 00000100:00100000:0.0:1788745010.439883:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2391:x1875634396746880:12345-192.168.201.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788745010.439923:0:24738:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from d68d9106-f31a-4f98-bd1c-504f18088b76@192.168.201.46@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:0.0:1788745010.439968:0:24738:0:(genops.c:1384:class_connect()) connect: client d68d9106-f31a-4f98-bd1c-504f18088b76, cookie 0x6e465a23bbc2a17e 00002000:00100000:0.0:1788745010.439991:0:24738:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d68d9106-f31a-4f98-bd1c-504f18088b76/ffff9ce287980800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788745010.440018:0:24738:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788745010.444570:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396747008 00000100:00100000:1.0:1788745010.444589:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396747008 00000100:00100000:1.0:1788745010.444697:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3 00000100:00100000:1.0:1788745010.444709:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18057:x1875634396747008:12345-192.168.201.46@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788745010.444828:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18057:x1875634396747008:12345-192.168.201.46@tcp:900:mount.lustre.0 Request processed in 121us (5123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.444853:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3 00002000:00080000:0.0:1788745010.447077:0:24738:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788745010.447164:0:24738:0:(import.c:65:import_set_state_nolock()) ffff9ce287985000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788745010.447277:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2391:x1875634396746880:12345-192.168.201.46@tcp:8:mount.lustre.0 Request processed in 7388us (7749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745010.447289:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 20 00000001:00100000:1.0:1788745010.454745:0:25074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d68d9106-f31a-4f98-bd1c-504f18088b76 00000001:00080000:1.0:1788745010.454765:0:25074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788745010.455228:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745010.455715:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396747136 00000100:00100000:3.0:1788745010.455732:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396747136 00000100:00100000:3.0:1788745010.455822:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 0 00000100:00100000:3.0:1788745010.455836:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18057:x1875634396747136:12345-192.168.201.46@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788745010.457460:0:22753:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1361us 00000004:00200000:0.0:1788745010.490289:0:22753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788745010.490505:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18057:x1875634396747136:12345-192.168.201.46@tcp:33:mount.lustre.0 Request processed in 34663us (35282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745010.490524:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 0 00000100:00100000:2.0:1788745010.694016:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745010.694193:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396747264 00000100:00100000:1.0:1788745010.694208:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396747264 00000100:00100000:1.0:1788745010.694344:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13 00000100:00100000:1.0:1788745010.694358:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18105:x1875634396747264:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:1.0:1788745010.694391:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788745010.694426:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f200/0x6e465a23bbc2a185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421b93 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.694523:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e000/0x6e465a23bbc2a18c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.694542:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e000/0x6e465a23bbc2a18c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.694560:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e000/0x6e465a23bbc2a18c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788745010.694648:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788745010.694653:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788745010.694703:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e000/0x6e465a23bbc2a18c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.694738:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f200/0x6e465a23bbc2a185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b93 expref: 8 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.694787:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e000/0x6e465a23bbc2a18c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b93 expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745010.694797:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3a1cb7900) 00010000:00010000:1.0:1788745010.694801:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788745010.694806:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403e000, rc 0) 00000100:00100000:1.0:1788745010.694893:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18105:x1875634396747264:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 539us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745010.694901:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13 00010000:00010000:1.0:1788745011.217173:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745012.245306:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745012.306902:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788745012.306935:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419933312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788745012.307081:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745012.307223:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419933312 00000100:00100000:2.0:1788745012.307234:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419933312 00000100:00100000:2.0:1788745012.307350:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788745012.307363:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419933312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788745012.307416:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788745012.307485:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419933312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745012.307493:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788745012.307778:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419933312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788745012.308729:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788745012.911081:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745012.911317:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396747392 00000100:00100000:0.0:1788745012.911334:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396747392 00000100:00100000:0.0:1788745012.911502:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 14 00000100:00100000:0.0:1788745012.911516:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18158:x1875634396747392:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:0.0:1788745012.911585:0:22751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788745012.911720:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18158:x1875634396747392:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 208us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745012.911729:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 14 00000100:00080000:2.0:1788745012.912953:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788745012.919145:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745012.919375:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396747520 00000100:00100000:1.0:1788745012.919390:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396747520 00000100:00100000:1.0:1788745012.919738:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 15 00000100:00100000:1.0:1788745012.919762:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18158:x1875634396747520:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:1.0:1788745012.919821:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788745012.919954:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18158:x1875634396747520:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 205us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745012.919964:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 15 00000100:00080000:2.0:1788745012.920905:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788745012.922939:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745012.923150:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396747648 00000100:00100000:2.0:1788745012.923164:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396747648 00000100:00100000:2.0:1788745012.923315:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 12 00000100:00100000:2.0:1788745012.923325:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18158:x1875634396747648:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:2.0:1788745012.923359:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788745012.923449:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18158:x1875634396747648:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 126us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745012.923455:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 12 00000100:00080000:0.0:1788745012.923526:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788745012.928551:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745012.929151:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396747776 00000100:00100000:1.0:1788745012.929189:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396747776 00000100:00080000:0.0:1788745012.929522:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788745012.929994:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13 00000100:00100000:1.0:1788745012.930021:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d68d9106-f31a-4f98-bd1c-504f18088b76+5:18158:x1875634396747776:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:1.0:1788745012.930080:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788745012.930765:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d68d9106-f31a-4f98-bd1c-504f18088b76+5:18158:x1875634396747776:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 759us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745012.930773:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13 00000100:00100000:3.0:1788745013.141121:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745013.141345:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396747904 00000100:00100000:2.0:1788745013.141361:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396747904 00000100:00100000:2.0:1788745013.141473:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 133 00000100:00100000:2.0:1788745013.141486:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+10:18193:x1875634396747904:12345-192.168.201.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788745013.141518:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745013.141551:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce381490a00/0x6e465a23bbc2a193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421b9a expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.141670:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce381490a00/0x6e465a23bbc2a193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b9a expref: 11 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.141686:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce381490a00/0x6e465a23bbc2a193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b9a expref: 11 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.141697:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce381490a00, rc 0) 00000100:00100000:2.0:1788745013.141778:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18193:x1875634396747904:12345-192.168.201.46@tcp:101:mount.lustre.0 Request processed in 294us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.141786:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 133 00000100:00100000:3.0:1788745013.150358:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745013.150496:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396748032 00000100:00100000:0.0:1788745013.150512:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396748032 00000100:00100000:0.0:1788745013.150603:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 134 00000100:00100000:0.0:1788745013.150616:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18193:x1875634396748032:12345-192.168.201.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788745013.150875:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18193:x1875634396748032:12345-192.168.201.46@tcp:501:mount.lustre.0 Request processed in 260us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745013.150885:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 134 00000100:00100000:3.0:1788745013.155608:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.155692:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396748160 00000100:00100000:1.0:1788745013.155708:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396748160 00000100:00100000:1.0:1788745013.155795:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 135 00000100:00100000:1.0:1788745013.155809:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18193:x1875634396748160:12345-192.168.201.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788745013.156044:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18193:x1875634396748160:12345-192.168.201.46@tcp:503:mount.lustre.0 Request processed in 238us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.156053:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 135 00000100:00100000:3.0:1788745013.168453:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745013.168717:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396748288 00000100:00100000:2.0:1788745013.168733:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396748288 00000100:00100000:2.0:1788745013.168818:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 136 00000100:00100000:2.0:1788745013.168832:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18198:x1875634396748288:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788745013.169077:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18198:x1875634396748288:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 247us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.169087:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 136 00000100:00100000:3.0:1788745013.196966:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745013.197066:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396748416 00000100:00100000:0.0:1788745013.197083:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396748416 00000100:00100000:0.0:1788745013.197171:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 137 00000100:00100000:0.0:1788745013.197197:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18198:x1875634396748416:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788745013.197530:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18198:x1875634396748416:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 346us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745013.197541:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 137 00000100:00100000:3.0:1788745013.199722:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.199853:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396748544 00000100:00100000:1.0:1788745013.199867:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396748544 00000100:00100000:1.0:1788745013.199990:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 138 00000100:00100000:1.0:1788745013.200004:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18198:x1875634396748544:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788745013.200318:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18198:x1875634396748544:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 317us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.200327:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 138 00000100:00100000:3.0:1788745013.209499:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745013.209635:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396748672 00000100:00100000:2.0:1788745013.209648:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396748672 00000100:00100000:2.0:1788745013.209731:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 139 00000100:00100000:2.0:1788745013.209745:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18193:x1875634396748672:12345-192.168.201.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788745013.209790:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745013.209816:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce381490800/0x6e465a23bbc2a19a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421bcb expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.209856:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce381490800/0x6e465a23bbc2a19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421bcb expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.209869:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce381490800/0x6e465a23bbc2a19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421bcb expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.209879:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce381490800, rc 0) 00000100:00100000:2.0:1788745013.210546:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18193:x1875634396748672:12345-192.168.201.46@tcp:101:mount.lustre.0 Request processed in 801us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.210607:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 139 00000100:00100000:3.0:1788745013.215896:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745013.216128:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396748800 00000100:00100000:0.0:1788745013.216143:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396748800 00000100:00100000:0.0:1788745013.216223:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 140 00000100:00100000:0.0:1788745013.216234:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18193:x1875634396748800:12345-192.168.201.46@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788745013.216299:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788745013.216337:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788745013.216341:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788745013.216345:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788745013.216349:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788745013.216352:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788745013.217972:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18193:x1875634396748800:12345-192.168.201.46@tcp:256:mount.lustre.0 Request processed in 1724us (2077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745013.218235:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 140 00000100:00100000:3.0:1788745013.220679:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745013.220758:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396748928 00000100:00100000:2.0:1788745013.220773:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396748928 00000100:00100000:2.0:1788745013.220910:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 141 00000100:00100000:2.0:1788745013.220921:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18193:x1875634396748928:12345-192.168.201.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788745013.220948:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745013.220970:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421bd2 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.221017:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.221030:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745013.221068:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce381491000, rc 0) 00000100:00100000:2.0:1788745013.221153:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18193:x1875634396748928:12345-192.168.201.46@tcp:101:mount.lustre.0 Request processed in 233us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.221161:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 141 00000100:00100000:3.0:1788745013.222909:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.223022:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396749056 00000100:00100000:1.0:1788745013.223035:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396749056 00000100:00100000:1.0:1788745013.223105:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 142 00000100:00100000:1.0:1788745013.223115:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18193:x1875634396749056:12345-192.168.201.46@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788745013.223349:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18193:x1875634396749056:12345-192.168.201.46@tcp:501:mount.lustre.0 Request processed in 236us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.223355:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 142 00000100:00100000:3.0:1788745013.225083:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745013.225198:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396749184 00000100:00100000:2.0:1788745013.225212:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396749184 00000100:00100000:2.0:1788745013.225318:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 143 00000100:00100000:2.0:1788745013.225331:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18193:x1875634396749184:12345-192.168.201.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788745013.225550:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18193:x1875634396749184:12345-192.168.201.46@tcp:503:mount.lustre.0 Request processed in 221us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.225560:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 143 00000100:00100000:2.0:1788745013.233684:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745013.234698:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396749312 00000100:00100000:3.0:1788745013.234732:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396749312 00000100:00100000:3.0:1788745013.234892:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 144 00000100:00100000:3.0:1788745013.234915:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18203:x1875634396749312:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788745013.235164:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18203:x1875634396749312:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 251us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745013.235175:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 144 00000100:00100000:2.0:1788745013.252237:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.252465:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396749440 00000100:00100000:1.0:1788745013.252479:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396749440 00000100:00100000:1.0:1788745013.252581:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 145 00000100:00100000:1.0:1788745013.252595:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18203:x1875634396749440:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788745013.252830:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18203:x1875634396749440:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 237us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.252840:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 145 00000100:00100000:1.0:1788745013.263719:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.263799:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.263834:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.263939:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.263968:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.264011:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745013.264140:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396749568 00000100:00100000:2.0:1788745013.264153:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396749568 00000100:00100000:2.0:1788745013.264194:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396749824 00000100:00100000:2.0:1788745013.264196:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396749824 00000100:00100000:2.0:1788745013.264207:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396750208 00000100:00100000:2.0:1788745013.264209:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396750208 00000100:00100000:2.0:1788745013.264238:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396750336 00000100:00100000:2.0:1788745013.264241:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396750336 00000100:00100000:2.0:1788745013.264307:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 39 00000100:00100000:2.0:1788745013.264318:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+7:2395:x1875634396750208:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788745013.264535:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+7:2395:x1875634396750208:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 217us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.264544:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 39 00000100:00100000:3.0:1788745013.266313:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 40 00000100:00100000:3.0:1788745013.266352:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2395:x1875634396750336:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745013.266464:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2395:x1875634396750336:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 136us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745013.266473:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 40 00000100:00100000:3.0:1788745013.266513:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 16 00000100:00100000:3.0:1788745013.266519:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1875634396749568:12345-192.168.201.46@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788745013.266550:0:22752:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 5c925a64-231d-4d66-9b5c-6862a11d831d@192.168.201.46@tcp t0 exp 0000000000000000 cur 738 last 0 00000020:00000080:3.0:1788745013.266616:0:22752:0:(genops.c:1384:class_connect()) connect: client 5c925a64-231d-4d66-9b5c-6862a11d831d, cookie 0x6e465a23bbc2a1a8 00000004:00100000:3.0:1788745013.266654:0:22752:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788745013.266804:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9ce39468f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788745013.266841:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2391:x1875634396749568:12345-192.168.201.46@tcp:38:mount.lustre.0 Request processed in 320us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745013.266849:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 16 00000100:00100000:3.0:1788745013.266864:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 17 00000100:00100000:3.0:1788745013.267126:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1875634396749824:12345-192.168.201.46@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788745013.267147:0:22752:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from 5c925a64-231d-4d66-9b5c-6862a11d831d@192.168.201.46@tcp t0 exp 0000000000000000 cur 738 last 0 00000020:00000080:3.0:1788745013.267179:0:22752:0:(genops.c:1384:class_connect()) connect: client 5c925a64-231d-4d66-9b5c-6862a11d831d, cookie 0x6e465a23bbc2a1af 00000004:00100000:3.0:1788745013.267212:0:22752:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788745013.267296:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9ce392b05000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788745013.267328:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2391:x1875634396749824:12345-192.168.201.46@tcp:38:mount.lustre.0 Request processed in 204us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745013.267336:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 17 00000100:00100000:0.0:1788745013.267852:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396750464 00000100:00100000:0.0:1788745013.267866:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396750464 00000100:00100000:0.0:1788745013.267932:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396750592 00000100:00100000:0.0:1788745013.267944:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396750592 00000100:00100000:0.0:1788745013.267973:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00100000:0.0:1788745013.267999:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2395:x1875634396750464:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1788745013.268043:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2395:x1875634396750464:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 46us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745013.268050:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00100000:0.0:1788745013.268066:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8 00000100:00100000:0.0:1788745013.268073:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2395:x1875634396750592:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1788745013.268099:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2395:x1875634396750592:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 27us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745013.268105:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8 00010000:00010000:2.0:1788745013.271180:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745013.271961:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745013.273399:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396749696 00000100:00100000:3.0:1788745013.273418:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396749696 00000100:00100000:2.0:1788745013.273799:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 18 00000100:00100000:2.0:1788745013.273814:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:0:x1875634396749696:12345-192.168.201.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788745013.273877:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788745013.273990:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:0:x1875634396749696:12345-192.168.201.46@tcp:41:mount.lustre.0 Request processed in 179us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.273998:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 18 00000100:00080000:0.0:1788745013.274310:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788745013.275069:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745013.275567:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.276465:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396750080 00000100:00100000:1.0:1788745013.276482:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396750080 00000100:00100000:1.0:1788745013.276577:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396749952 00000100:00100000:1.0:1788745013.276581:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396749952 00000100:00100000:1.0:1788745013.276634:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 19 00000100:00100000:1.0:1788745013.276647:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18193:x1875634396750080:12345-192.168.201.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788745013.276726:0:25091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788745013.276820:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18193:x1875634396750080:12345-192.168.201.46@tcp:41:mount.lustre.0 Request processed in 176us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.276837:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 19 00000100:00100000:1.0:1788745013.276857:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 20 00000100:00100000:1.0:1788745013.276864:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:0:x1875634396749952:12345-192.168.201.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788745013.276886:0:25091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788745013.276913:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:0:x1875634396749952:12345-192.168.201.46@tcp:41:mount.lustre.0 Request processed in 50us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.276919:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 20 00000100:00080000:0.0:1788745013.277334:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788745013.280503:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745013.280678:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396750720 00000100:00100000:1.0:1788745013.280696:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396750720 00000100:00100000:1.0:1788745013.280840:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:1.0:1788745013.280855:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18193:x1875634396750720:12345-192.168.201.46@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788745013.281014:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18193:x1875634396750720:12345-192.168.201.46@tcp:40:mount.lustre.0 Request processed in 162us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.281023:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:0.0:1788745013.283815:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745013.283866:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745013.283972:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396751104 00000100:00100000:3.0:1788745013.284115:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396751104 00000100:00100000:3.0:1788745013.284187:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 4 00000100:00100000:3.0:1788745013.284200:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18193:x1875634396751104:12345-192.168.201.46@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788745013.284363:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18193:x1875634396751104:12345-192.168.201.46@tcp:900:mount.lustre.0 Request processed in 165us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745013.284371:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 4 00000100:00100000:0.0:1788745013.284670:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745013.287641:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745013.287863:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396751232 00000100:00100000:3.0:1788745013.287888:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396751232 00000100:00100000:3.0:1788745013.287965:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1 00000100:00100000:3.0:1788745013.287992:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18193:x1875634396751232:12345-192.168.201.46@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788745013.288208:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788745013.288364:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18193:x1875634396751232:12345-192.168.201.46@tcp:33:mount.lustre.0 Request processed in 388us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745013.288373:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1 00000100:00100000:2.0:1788745013.289725:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396750848 00000100:00100000:2.0:1788745013.289745:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396750848 00000100:00100000:2.0:1788745013.289804:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396750976 00000100:00100000:2.0:1788745013.289808:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396750976 00000100:00100000:2.0:1788745013.289934:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:2.0:1788745013.289945:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1875634396750848:12345-192.168.201.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788745013.290004:0:24261:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 5c925a64-231d-4d66-9b5c-6862a11d831d@192.168.201.46@tcp t0 exp 0000000000000000 cur 738 last 0 00000020:00000080:2.0:1788745013.290047:0:24261:0:(genops.c:1384:class_connect()) connect: client 5c925a64-231d-4d66-9b5c-6862a11d831d, cookie 0x6e465a23bbc2a1b6 00002000:00100000:2.0:1788745013.290063:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5c925a64-231d-4d66-9b5c-6862a11d831d/ffff9ce3be837800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788745013.290080:0:24261:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788745013.290169:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788745013.290217:0:24261:0:(import.c:65:import_set_state_nolock()) ffff9ce3be834000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788745013.290326:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2391:x1875634396750848:12345-192.168.201.46@tcp:8:mount.lustre.0 Request processed in 380us (6457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.290335:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:2.0:1788745013.290375:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 22 00000100:00100000:2.0:1788745013.290382:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1875634396750976:12345-192.168.201.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788745013.290402:0:24261:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 5c925a64-231d-4d66-9b5c-6862a11d831d@192.168.201.46@tcp t0 exp 0000000000000000 cur 738 last 0 00000020:00000080:2.0:1788745013.290441:0:24261:0:(genops.c:1384:class_connect()) connect: client 5c925a64-231d-4d66-9b5c-6862a11d831d, cookie 0x6e465a23bbc2a1bd 00002000:00100000:2.0:1788745013.290446:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5c925a64-231d-4d66-9b5c-6862a11d831d/ffff9ce3be834800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788745013.290454:0:24261:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788745013.290507:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788745013.290523:0:24261:0:(import.c:65:import_set_state_nolock()) ffff9ce3be836800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788745013.290548:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2391:x1875634396750976:12345-192.168.201.46@tcp:8:mount.lustre.0 Request processed in 165us (5880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.290568:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 22 00000100:00100000:2.0:1788745013.328506:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcafb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419933440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788745013.328612:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745013.328688:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419933440 00000100:00100000:2.0:1788745013.328697:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419933440 00000100:00100000:2.0:1788745013.328765:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788745013.328775:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcaf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419933440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788745013.328803:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788745013.328848:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcaf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419933440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745013.328856:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788745013.328893:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788745013.328940:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcafb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419933440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788745013.330326:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419933568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788745013.330392:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745013.330452:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419933568 00000100:00100000:1.0:1788745013.330459:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419933568 00000100:00100000:1.0:1788745013.330518:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788745013.330527:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419933568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788745013.330556:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788745013.330606:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419933568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.330613:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788745013.331183:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419933696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788745013.331224:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745013.334039:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419933696 00000100:00100000:1.0:1788745013.334062:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419933696 00000100:00100000:1.0:1788745013.334126:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788745013.334139:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419933696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788745013.334180:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788745013.334306:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419933696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745013.334315:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788745013.334385:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419933568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788745013.334507:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419933696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788745013.472487:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745013.472802:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396751360 00000100:00100000:3.0:1788745013.472817:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396751360 00000100:00100000:3.0:1788745013.472901:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 22 00000100:00100000:3.0:1788745013.472914:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18226:x1875634396751360:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1788745013.472961:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745013.473005:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33ea00/0x6e465a23bbc2a1c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c03 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745013.473092:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745013.473110:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745013.473144:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788745013.473203:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788745013.473207:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788745013.473234:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745013.473321:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33ea00/0x6e465a23bbc2a1c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 8 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745013.473345:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745013.473354:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3a1cb7900) 00010000:00010000:3.0:1788745013.473358:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788745013.473362:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33fa00, rc 0) 00000100:00100000:3.0:1788745013.473826:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+7:18226:x1875634396751360:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 913us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745013.473836:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 22 00010000:00010000:1.0:1788745014.288642:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788745014.804866:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788745015.312462:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745015.376723:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419934080:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.376812:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745015.376873:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419934592:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.376894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745015.376912:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1875634419935104:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.376935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745015.376970:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788745015.376976:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419934208:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.376999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745015.377011:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419934720:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377027:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745015.377039:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419935232:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377054:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745015.377084:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419934080 00000100:00100000:1.0:1788745015.377104:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419934080 00000100:00100000:1.0:1788745015.377159:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419934592 00000100:00100000:1.0:1788745015.377162:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419934592 00000100:00100000:1.0:1788745015.377176:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788745015.377184:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419934080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377234:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419934080:12345-0@lo:400:kworker.0 Request processed in 51us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745015.377241:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788745015.377282:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788745015.377288:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419934592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377312:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419934592:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745015.377317:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788745015.377335:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419935104 00000100:00100000:1.0:1788745015.377338:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419935104 00000100:00100000:1.0:1788745015.377367:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419935232 00000100:00100000:1.0:1788745015.377369:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419935232 00000100:00100000:1.0:1788745015.377383:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788745015.377389:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875634419935104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377413:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875634419935104:12345-0@lo:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745015.377418:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788745015.377427:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788745015.377432:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419935232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377451:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875634419935232:12345-0@lo:400:kworker.0 Request processed in 19us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745015.377456:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788745015.377479:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788745015.377484:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788745015.377511:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288270e00 x1875634419935232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745015.377524:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1875634419935232:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377534:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419934080:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377540:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419934592:0@lo:400:kworker.0 00000100:00100000:1.0:1788745015.377548:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1875634419935104:0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.377647:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419934208 00000100:00100000:3.0:1788745015.377651:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419934208 00000100:00100000:3.0:1788745015.377686:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419934720 00000100:00100000:3.0:1788745015.377689:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419934720 00000100:00100000:3.0:1788745015.377705:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788745015.377712:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419934208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.377752:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419934208:12345-0@lo:400:kworker.0 Request processed in 41us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.377758:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788745015.377769:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788745015.377775:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419934720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.377796:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419934720:12345-0@lo:400:kworker.0 Request processed in 22us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.377801:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788745015.377824:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419934208:0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.377833:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bd4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419934720:0@lo:400:kworker.0 00000100:00080000:1.0:1788745015.378180:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788745015.378269:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce287a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419933824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788745015.378306:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745015.378335:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419934336:0@lo:400:kworker.0 00000100:00100000:2.0:1788745015.378352:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745015.378366:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419934848:0@lo:400:kworker.0 00000100:00100000:2.0:1788745015.378391:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745015.378404:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1875634419935360:0@lo:400:kworker.0 00000100:00100000:2.0:1788745015.378426:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745015.378443:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788745015.378449:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419933952:0@lo:400:kworker.0 00000100:00100000:2.0:1788745015.378469:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745015.378490:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419934464:0@lo:400:kworker.0 00000100:00100000:2.0:1788745015.378506:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745015.378530:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419934976:0@lo:400:kworker.0 00000100:00100000:2.0:1788745015.378548:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745015.378561:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419935488:0@lo:400:kworker.0 00000100:00100000:2.0:1788745015.378579:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745015.378599:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419934336 00000100:00100000:2.0:1788745015.378603:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419934336 00000100:00100000:2.0:1788745015.378627:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419934848 00000100:00100000:3.0:1788745015.378788:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419933952 00000100:00100000:3.0:1788745015.378792:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419933952 00000100:00100000:3.0:1788745015.378819:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788745015.378826:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3634:x1875634419933952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.378867:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3634:x1875634419933952:12345-0@lo:400:kworker.0 Request processed in 42us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.378873:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788745015.378897:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788745015.378906:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce287a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419935616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788745015.378936:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745015.378992:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419935360 00000100:00100000:3.0:1788745015.378996:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419935360 00000100:00100000:3.0:1788745015.379015:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419934464 00000100:00100000:3.0:1788745015.379017:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419934464 00000100:00100000:3.0:1788745015.379026:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419934976 00000100:00100000:3.0:1788745015.379028:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419934976 00000100:00100000:3.0:1788745015.379036:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419935488 00000100:00100000:3.0:1788745015.379037:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419935488 00000100:00100000:3.0:1788745015.379049:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788745015.379055:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcaf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875634419935360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379082:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcaf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875634419935360:12345-0@lo:400:kworker.0 Request processed in 27us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.379088:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788745015.379096:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788745015.379101:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcaf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419934464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379133:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcaf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875634419934464:12345-0@lo:400:kworker.0 Request processed in 32us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.379139:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788745015.379148:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788745015.379153:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcaf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419934976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379173:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcaf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875634419934976:12345-0@lo:400:kworker.0 Request processed in 20us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.379178:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788745015.379186:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788745015.379191:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875634419935488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379210:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875634419935488:12345-0@lo:400:kworker.0 Request processed in 19us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.379220:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788745015.379238:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788745015.379265:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcaf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419934336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379292:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcaf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419934336:12345-0@lo:400:kworker.0 Request processed in 49us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.379297:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788745015.379326:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788745015.379328:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788745015.379330:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788745015.379350:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419933952:0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379361:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875634419934464:0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379369:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875634419934976:0@lo:400:kworker.0 00010000:00080000:3.0:1788745015.379379:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce288270a80 x1875634419935488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788745015.379389:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1875634419935488:0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379396:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788745015.379407:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419934336:0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379415:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1875634419935360:0@lo:400:kworker.0 00000100:00100000:3.0:1788745015.379442:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419933824 00000100:00100000:3.0:1788745015.379445:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419933824 00000100:00100000:3.0:1788745015.379465:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419935616 00000100:00100000:3.0:1788745015.379468:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419935616 00000100:00100000:3.0:1788745015.379476:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788745015.379481:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419933824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788745015.379508:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788745015.379550:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419933824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.379556:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788745015.379566:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788745015.379571:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419935616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788745015.379580:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788745015.379604:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875634419935616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745015.379609:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788745015.379622:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788745015.379655:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce287a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1875634419935616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788745015.379680:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce287a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419933824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788745015.379911:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419934848 00000100:00100000:2.0:1788745015.379954:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788745015.379961:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcaf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419934848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788745015.380000:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcaf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419934848:12345-0@lo:400:kworker.0 Request processed in 39us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745015.380005:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788745015.380029:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419934848:0@lo:400:kworker.0 00000001:00100000:2.0:1788745015.904621:0:24255:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5c925a64-231d-4d66-9b5c-6862a11d831d 00000001:00100000:2.0:1788745015.904635:0:24255:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d68d9106-f31a-4f98-bd1c-504f18088b76 00000001:00100000:3.0:1788745015.909486:0:22730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5c925a64-231d-4d66-9b5c-6862a11d831d 00000001:00100000:3.0:1788745015.909512:0:22730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d68d9106-f31a-4f98-bd1c-504f18088b76 00000001:00100000:2.0:1788745015.910624:0:23484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5c925a64-231d-4d66-9b5c-6862a11d831d 00000001:00100000:2.0:1788745015.910650:0:23484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d68d9106-f31a-4f98-bd1c-504f18088b76 00010000:00010000:3.0:1788745016.341519:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788745016.559519:0:25633:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788745017.360565:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745017.424738:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788745017.424765:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419935744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788745017.424837:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745017.425015:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419935744 00000100:00100000:2.0:1788745017.425024:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419935744 00000100:00100000:2.0:1788745017.425089:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788745017.425111:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419935744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788745017.425142:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788745017.425200:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419935744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745017.425208:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788745017.425297:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419935744:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788745017.425486:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788745018.391270:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788745018.444588:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444648:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444682:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444719:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444742:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444766:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444790:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444814:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444883:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745018.444933:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396751744 00000100:00100000:3.0:1788745018.444948:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396751744 00000100:00100000:3.0:1788745018.445031:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396752256 00000100:00100000:3.0:1788745018.445035:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396752256 00000100:00100000:3.0:1788745018.445056:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396751616 00000100:00100000:3.0:1788745018.445059:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396751616 00000100:00100000:3.0:1788745018.445093:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396752128 00000100:00100000:3.0:1788745018.445096:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396752128 00000100:00100000:3.0:1788745018.445123:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 47 00000100:00100000:3.0:1788745018.445137:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2392:x1875634396751744:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745018.445295:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2392:x1875634396751744:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 113us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745018.445304:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 47 00000100:00100000:3.0:1788745018.445327:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 48 00000100:00100000:3.0:1788745018.445334:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2392:x1875634396752256:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745018.445364:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2392:x1875634396752256:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 31us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745018.445371:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 48 00000100:00100000:3.0:1788745018.445383:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 49 00000100:00100000:3.0:1788745018.445389:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2392:x1875634396751616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745018.445419:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2392:x1875634396751616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 30us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745018.445426:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 49 00000100:00100000:3.0:1788745018.445438:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 50 00000100:00100000:3.0:1788745018.445444:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2392:x1875634396752128:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745018.445483:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2392:x1875634396752128:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 40us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745018.445490:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 50 00000100:00100000:3.0:1788745018.445514:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396752000 00000100:00100000:3.0:1788745018.445518:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396752000 00000100:00100000:3.0:1788745018.445543:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396752512 00000100:00100000:3.0:1788745018.445547:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396752512 00000100:00100000:3.0:1788745018.445560:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396751872 00000100:00100000:3.0:1788745018.445563:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396751872 00000100:00100000:3.0:1788745018.445577:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396752384 00000100:00100000:3.0:1788745018.445579:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396752384 00000100:00100000:3.0:1788745018.445597:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13 00000100:00100000:3.0:1788745018.445603:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2392:x1875634396752000:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745018.445633:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2392:x1875634396752000:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745018.445640:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13 00000100:00100000:3.0:1788745018.445655:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 14 00000100:00100000:3.0:1788745018.445661:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2392:x1875634396752512:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745018.445690:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2392:x1875634396752512:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 28us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745018.445696:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 14 00000100:00100000:3.0:1788745018.445708:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 15 00000100:00100000:3.0:1788745018.445715:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2392:x1875634396751872:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745018.445740:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2392:x1875634396751872:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 26us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745018.445758:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 15 00000100:00100000:3.0:1788745018.445771:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 16 00000100:00100000:3.0:1788745018.445779:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2392:x1875634396752384:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745018.445810:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2392:x1875634396752384:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 30us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745018.445816:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 16 00000100:00080000:3.0:1788745018.445860:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788745018.445867:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788745018.445874:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788745018.445877:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788745018.446086:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396751488 00000100:00100000:2.0:1788745018.446094:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396751488 00000100:00100000:2.0:1788745018.446144:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 147 00000100:00100000:2.0:1788745018.446154:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:2392:x1875634396751488:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788745018.446185:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:2392:x1875634396751488:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 34us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745018.446192:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 147 00000100:00100000:2.0:1788745018.449258:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcafbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419935872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788745018.449325:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745018.449677:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419935872 00000100:00100000:2.0:1788745018.449686:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419935872 00000100:00100000:2.0:1788745018.449753:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788745018.449762:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcaf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419935872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788745018.449787:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788745018.449920:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcaf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419935872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745018.450057:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788745018.450121:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcafbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419935872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788745018.450281:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788745018.451028:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788745018.451040:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcafbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419936000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788745018.451082:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745018.451115:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419936000 00000100:00100000:2.0:1788745018.451120:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419936000 00000100:00100000:2.0:1788745018.451151:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788745018.451157:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcafa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419936000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788745018.451186:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788745018.451222:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcafa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419936000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745018.451228:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788745018.451288:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcafbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419936000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788745018.452550:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788745018.452566:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419936128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788745018.452615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745018.452655:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419936128 00000100:00100000:0.0:1788745018.452660:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419936128 00000100:00100000:0.0:1788745018.452698:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788745018.452706:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419936128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788745018.452736:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788745018.452780:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419936128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745018.452788:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788745018.452910:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419936128:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788745018.994399:0:25074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5c925a64-231d-4d66-9b5c-6862a11d831d 00000040:00080000:1.0:1788745019.345985:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788745019.409956:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745020.433482:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788745020.499381:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce287a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419936256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788745020.499508:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.499614:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce287a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419936384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788745020.499642:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.499684:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419936256 00000100:00100000:3.0:1788745020.499695:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419936256 00000100:00100000:3.0:1788745020.499756:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419936384 00000100:00100000:3.0:1788745020.499760:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419936384 00000100:00100000:3.0:1788745020.499782:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788745020.499791:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419936256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788745020.499830:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788745020.499886:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419936256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745020.499894:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788745020.499911:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788745020.499933:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419936384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788745020.499943:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788745020.499966:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419936384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745020.499971:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788745020.499990:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788745020.500027:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce287a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419936384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788745020.500066:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce287a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419936256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788745020.504879:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3635:1875634419936512:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.504998:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.505067:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419937024:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.505116:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.505149:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1875634419937536:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.505176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.505207:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788745020.505215:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419936896:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.505236:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.505278:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419937408:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.505302:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.505339:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419936512 00000100:00100000:3.0:1788745020.505350:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419936512 00000100:00100000:3.0:1788745020.505415:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788745020.505809:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3635:x1875634419936512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.505900:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3635:x1875634419936512:12345-0@lo:400:kworker.0 Request processed in 474us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745020.505927:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788745020.505976:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419937536 00000100:00100000:3.0:1788745020.505995:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419937536 00000100:00100000:3.0:1788745020.506045:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419936896 00000100:00100000:3.0:1788745020.506048:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419936896 00000100:00100000:3.0:1788745020.506060:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419937408 00000100:00100000:3.0:1788745020.506063:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419937408 00000100:00100000:3.0:1788745020.506081:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788745020.506089:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875634419937536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.506127:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875634419937536:12345-0@lo:400:kworker.0 Request processed in 39us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745020.506134:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788745020.506148:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788745020.506153:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419936896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.506182:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419936896:12345-0@lo:400:kworker.0 Request processed in 28us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745020.506188:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788745020.506200:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788745020.506206:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419937408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.506232:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419937408:12345-0@lo:400:kworker.0 Request processed in 27us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745020.506239:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788745020.506305:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419936640:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.506337:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.506362:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419937152:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.506386:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.506418:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1875634419937664:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.507130:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.507173:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788745020.507184:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419936768:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.507216:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.507324:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875634419937280:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.507349:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.507367:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1875634419937792:0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.507388:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745020.507440:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419937024 00000100:00100000:3.0:1788745020.507448:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419937024 00000100:00100000:3.0:1788745020.507862:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419936640 00000100:00100000:3.0:1788745020.507868:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419936640 00000100:00100000:3.0:1788745020.507892:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788745020.507901:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419937024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.507968:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875634419937024:12345-0@lo:400:kworker.0 Request processed in 68us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745020.507976:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788745020.507996:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788745020.508002:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419936640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745020.508037:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419936640:12345-0@lo:400:kworker.0 Request processed in 36us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745020.508043:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788745020.508209:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419937664 00000100:00100000:0.0:1788745020.508215:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419937664 00000100:00100000:0.0:1788745020.508275:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419937280 00000100:00100000:0.0:1788745020.508279:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419937280 00000100:00100000:0.0:1788745020.508292:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419937792 00000100:00100000:0.0:1788745020.508294:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419937792 00000100:00100000:0.0:1788745020.508311:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788745020.508317:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875634419937664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.508360:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875634419937664:12345-0@lo:400:kworker.0 Request processed in 43us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745020.508367:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788745020.508385:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788745020.508390:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875634419937280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.508434:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875634419937280:12345-0@lo:400:kworker.0 Request processed in 27us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745020.508458:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788745020.508471:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788745020.508477:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875634419937792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.508516:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875634419937792:12345-0@lo:400:kworker.0 Request processed in 39us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745020.508522:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788745020.510654:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788745020.510666:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788745020.510821:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875634419937280:0@lo:400:kworker.0 00010000:00080000:0.0:1788745020.510874:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3b405d880 x1875634419937792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788745020.510888:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1875634419937792:0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.510908:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419936640:0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.510925:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1875634419937664:0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.510983:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419936896:0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.510999:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419937408:0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.511012:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3635:1875634419936512:0@lo:400:kworker.0 00000100:00100000:0.0:1788745020.511025:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1875634419937024:0@lo:400:kworker.0 00010000:00080000:0.0:1788745020.511041:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce3b405ca80 x1875634419937536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788745020.511052:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1875634419937536:0@lo:400:kworker.0 00000100:00100000:1.0:1788745020.511213:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419937152 00000100:00100000:1.0:1788745020.511225:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419937152 00000100:00100000:1.0:1788745020.511322:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419936768 00000100:00100000:1.0:1788745020.511327:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419936768 00000100:00100000:1.0:1788745020.511365:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788745020.511377:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419937152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745020.513984:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419937152:12345-0@lo:400:kworker.0 Request processed in 2590us (7576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745020.514004:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788745020.514073:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788745020.514096:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419936768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788745020.514189:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419936768:12345-0@lo:400:kworker.0 Request processed in 108us (6973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745020.514196:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788745020.515042:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419936768:0@lo:400:kworker.0 00000100:00100000:1.0:1788745020.515061:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419937152:0@lo:400:kworker.0 00000100:00080000:0.0:1788745020.515286:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788745020.859185:0:25780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5787c740 20000000:00000080:2.0:1788745020.859208:0:25780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ce3bca95c00 uarg=0000000000000000 20000000:01000000:2.0:1788745020.859728:0:25780:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788745020.859736:0:25780:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788745020.859742:0:25780:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788745020.860219:0:25781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788745020.860881:0:25780:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788745020.868958:0:25780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788745020.876929:0:25780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.876971:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.876978:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877006:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877011:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877019:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877024:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877029:0:25780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877170:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877188:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 12 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.877203:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcafbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419937920:192.168.201.46@tcp:104: 00010000:00010000:2.0:1788745020.877345:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877351:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 12 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.877357:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcafad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938048:192.168.201.46@tcp:104: 00010000:00010000:2.0:1788745020.877387:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877393:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 23 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.877401:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcafb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938176:0@lo:104: 00000100:00100000:2.0:1788745020.877439:0:25780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745020.877477:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419938176 00010000:00010000:2.0:1788745020.877483:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877490:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 23 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745020.877490:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419938176 00000100:00100000:2.0:1788745020.877498:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcaf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938304:0@lo:104: 00000100:00100000:2.0:1788745020.877513:0:25780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788745020.877528:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877534:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 23 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.877540:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcaf9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938432:0@lo:104: 00000100:00100000:1.0:1788745020.877558:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419938304 00000100:00100000:1.0:1788745020.877563:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419938304 00000100:00100000:2.0:1788745020.877571:0:25780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745020.877579:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419938432 00000100:00100000:1.0:1788745020.877583:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419938432 00010000:00010000:2.0:1788745020.877591:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.877598:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 23 pid: 22745 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745020.877605:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788745020.877618:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcb55880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938560:0@lo:104: 00000100:00100000:1.0:1788745020.877624:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcaf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+5:25780:x1875634419938176:12345-0@lo:104: 00000100:00100000:2.0:1788745020.877646:0:25780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788745020.877652:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.877660:0:25780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38982e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788745020.877737:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788745020.877744:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcaf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+5:25780:x1875634419938176:12345-0@lo:104: Request processed in 126us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745020.877751:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788745020.877769:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419938560 00000100:00100000:1.0:1788745020.877772:0:22734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419938560 00000100:00100000:1.0:1788745020.877786:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788745020.877792:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcafaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+5:25780:x1875634419938304:12345-0@lo:104: 00010000:00010000:1.0:1788745020.877800:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.877852:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788745020.877858:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcafaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+5:25780:x1875634419938304:12345-0@lo:104: Request processed in 67us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745020.877864:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788745020.877876:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788745020.877883:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:25780:x1875634419938432:12345-0@lo:104: 00010000:00010000:1.0:1788745020.877890:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.877924:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788745020.877929:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+4:25780:x1875634419938432:12345-0@lo:104: Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745020.877935:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788745020.877947:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788745020.877954:0:22734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:25780:x1875634419938560:12345-0@lo:104: 00010000:00010000:1.0:1788745020.877961:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.877987:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788745020.877991:0:22734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+3:25780:x1875634419938560:12345-0@lo:104: Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745020.877996:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788745020.878013:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788745020.878020:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878037:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921400 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788745020.878043:0:24937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878052:0:24937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788745020.878061:0:24937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788745020.878067:0:24937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788745020.878100:0:24937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878107:0:24937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788745020.878131:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878138:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce287921400/0x6e465a23bbc29fef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29ff6 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878154:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788745020.878157:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878163:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3b403e800 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788745020.878166:0:24937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745020.878181:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788745020.878182:0:24937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745020.878188:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788745020.878189:0:24937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788745020.878196:0:24937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788745020.878196:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3b403f000 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:0.0:1788745020.878199:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745020.878206:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878211:0:24937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788745020.878213:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788745020.878218:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788745020.878230:0:24937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788745020.878232:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878236:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745020.878238:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788745020.878268:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3b403e800/0x6e465a23bbc29e75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e7c expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878281:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788745020.878284:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878289:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f2200 already unused, calling callback (ffffffffc11b0c20) 10000000:00010000:1.0:1788745020.878292:0:24937:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878298:0:24937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788745020.878305:0:24937:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788745020.878316:0:24937:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788745020.878330:0:24937:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878337:0:24937:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788745020.878340:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878343:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745020.878348:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f000/0x6e465a23bbc29e36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e3d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878350:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff9ce3813f2200/0x6e465a23bbc29e28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6e465a23bbc29e2f expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745020.878360:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745020.878361:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745020.878363:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745020.878364:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745020.878366:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788745020.878367:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788745020.878369:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745020.878380:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419938688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788745020.878384:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419939072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788745020.878413:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745020.878439:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788745020.878445:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419938816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788745020.878466:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745020.878514:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419938944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788745020.878537:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745020.878566:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419938688 00000100:00100000:1.0:1788745020.878570:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419938688 00010000:00010000:1.0:1788745020.878593:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 24 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745020.878608:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419938816 00000100:00100000:1.0:1788745020.878610:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419938816 00010000:00010000:1.0:1788745020.878630:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 25 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745020.878640:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419938944 00000100:00100000:1.0:1788745020.878643:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419938944 00010000:00010000:1.0:1788745020.878653:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 26 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745020.878663:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788745020.878669:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+26:3634:x1875634419938688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788745020.878680:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788745020.878685:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 26 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878694:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 26 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878711:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788745020.878740:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+26:3634:x1875634419938688:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745020.878747:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788745020.878760:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788745020.878765:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+25:3634:x1875634419938816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788745020.878786:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788745020.878790:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 25 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878798:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 25 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.878819:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788745020.878853:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+25:3634:x1875634419938816:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745020.878857:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745020.878860:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788745020.878873:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419939072 00000100:00100000:1.0:1788745020.878876:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419939072 00010000:00010000:1.0:1788745020.878888:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 25 pid: 22745 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745020.878899:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788745020.878909:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+25:3636:x1875634419938944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788745020.878917:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788745020.878921:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 25 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745020.878930:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 25 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745020.878940:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788745020.878967:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+25:3636:x1875634419938944:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (429us total) trans 0 rc 0/0 00010000:00010000:2.0:1788745020.879505:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3a6bf6c00/0x6e465a23bbc29ff6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29fef expref: 25 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.879515:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcafb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938176:0@lo:104: 00010000:00010000:2.0:1788745020.879522:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce381490600/0x6e465a23bbc29e7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29e75 expref: 24 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.879528:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcaf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938304:0@lo:104: 00010000:00010000:2.0:1788745020.879533:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3b403ee00/0x6e465a23bbc29e3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29e36 expref: 23 pid: 22744 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.879539:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcaf9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938432:0@lo:104: 00000100:00100000:2.0:1788745020.879545:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcb55880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938560:0@lo:104: 00000100:00100000:2.0:1788745020.880645:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3636:1875634419938944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788745020.880696:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419938816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788745020.880706:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3634:1875634419938688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788745020.881145:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788745020.881181:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:3637:x1875634419939072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788745020.881206:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788745020.881776:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 22 pid: 22745 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.881798:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 22 pid: 22745 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.881822:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3a6bf7c00/0x6e465a23bbc29e2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6e465a23bbc29e28 expref: 22 pid: 22745 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745020.881854:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788745020.881964:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:3637:x1875634419939072:12345-0@lo:103:ldlm_bl.0 Request processed in 807us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745020.881974:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788745020.882119:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419939072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788745020.883567:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788745020.883914:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcafbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419937920:192.168.201.46@tcp:104: 00000100:00100000:2.0:1788745020.883926:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcafad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875634419938048:192.168.201.46@tcp:104: 00010000:00010000:2.0:1788745020.883978:0:25780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745020.899221:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745020.899431:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745020.899768:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396752640 00000100:00100000:2.0:1788745020.899785:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396752640 00010000:00010000:2.0:1788745020.899852:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 13 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.899898:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396752768 00000100:00100000:2.0:1788745020.899902:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396752768 00010000:00010000:2.0:1788745020.899914:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 14 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745020.899936:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13 00000100:00100000:2.0:1788745020.899946:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89bd4431-e5bd-4a95-a183-977432e8cc17+14:2393:x1875634396752640:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788745020.899967:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788745020.899973:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 14 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.899988:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 14 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900011:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce381491000/0x6e465a23bbc2a1a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421bd2 expref: 14 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900033:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788745020.900053:0:22737:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788745020.900064:0:22737:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788745020.900119:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287b0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:2393:x1875634396752640:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 173us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745020.900126:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13 00000100:00100000:2.0:1788745020.900192:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 14 00000100:00100000:2.0:1788745020.900199:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89bd4431-e5bd-4a95-a183-977432e8cc17+12:2393:x1875634396752768:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788745020.900227:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788745020.900232:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 12 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900242:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 12 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900731:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce381490e00/0x6e465a23bbc2a162 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421b62 expref: 12 pid: 22742 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900749:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900757:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900775:0:22735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900782:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900789:0:22735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900795:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900802:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f3400 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745020.900806:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900827:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900854:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900870:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788745020.900908:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89bd4431-e5bd-4a95-a183-977432e8cc17+11:2393:x1875634396752768:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 708us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745020.900916:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 14 00010000:00010000:2.0:1788745020.900951:0:25780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900960:0:25780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745020.900966:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ce3813f3400/0x6e465a23bbc2a1d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745021.459972:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788745022.290286:0:22747:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788745022.290300:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce3bf870800 from 13 10000000:01000000:1.0:1788745022.290334:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788745022.290402:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f200/0x6e465a23bbc2a1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.290415:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f200/0x6e465a23bbc2a1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.290444:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f200/0x6e465a23bbc2a1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745022.290482:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.290585:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745022.290659:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419000 going to sleep for 11 seconds 00000100:00100000:3.0:1788745022.290705:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419939200 00000100:00100000:3.0:1788745022.290735:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419939200 00000100:00100000:3.0:1788745022.290851:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788745022.290864:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+20:22747:x1875634419939200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788745022.290895:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745022.290917:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3bd33e000/0x6e465a23bbc2a1e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc2a1d9 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.290948:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3bd33e000/0x6e465a23bbc2a1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc2a1d9 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.290960:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3bd33e000/0x6e465a23bbc2a1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc2a1d9 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.290969:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33e000, rc 0) 00000100:00100000:3.0:1788745022.291045:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419939200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.291076:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788745022.291146:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788745022.291168:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f200/0x6e465a23bbc2a1d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1e0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.291181:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f200/0x6e465a23bbc2a1d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2a1e0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745022.291301:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.291338:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745022.291371:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419000 going to sleep for 11 seconds 00000100:00100000:3.0:1788745022.291633:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419939328 00000100:00100000:3.0:1788745022.291640:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419939328 00000100:00100000:3.0:1788745022.291681:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788745022.291689:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419939328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.291926:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419939328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.291934:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788745022.292169:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.292216:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.292301:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745022.292346:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419000 going to sleep for 11 seconds 00000100:00100000:0.0:1788745022.294595:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419939456 00000100:00100000:0.0:1788745022.294619:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419939456 00000100:00100000:0.0:1788745022.294736:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788745022.294749:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419939456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788745022.294998:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419939456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745022.295007:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788745022.300098:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788745022.303362:0:25794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788745022.303866:0:22747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788745022.303903:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788745022.303918:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f200/0x6e465a23bbc2a1d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1e0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.303947:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3b403f200/0x6e465a23bbc2a1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1e0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788745022.303962:0:22747:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788745022.303965:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce288114000 from 13 10000000:01000000:0.0:1788745022.303969:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788745022.304017:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc2a1e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.304025:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc2a1e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.304569:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc2a1e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745022.304606:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788745022.304699:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745022.304883:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3bcb44000 going to sleep for 11 seconds 00000100:00100000:3.0:1788745022.315369:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419939584 00000100:00100000:3.0:1788745022.315393:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419939584 00000100:00100000:3.0:1788745022.315496:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788745022.315510:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+21:22747:x1875634419939584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788745022.315536:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745022.315574:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3bd33ea00/0x6e465a23bbc2a1ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc2a1e7 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.315638:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3bd33ea00/0x6e465a23bbc2a1ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc2a1e7 expref: 22 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.315651:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3bd33ea00/0x6e465a23bbc2a1ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc2a1e7 expref: 22 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.316007:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33ea00, rc 0) 00000100:00100000:3.0:1788745022.316133:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:22747:x1875634419939584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 626us (11433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.316140:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788745022.316343:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788745022.316370:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc2a1e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1ee expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.316381:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc2a1e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2a1ee expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745022.316488:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.316529:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745022.316589:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788745022.316806:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419939712 00000100:00100000:3.0:1788745022.316813:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419939712 00000100:00100000:3.0:1788745022.316862:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788745022.316872:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:22747:x1875634419939712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.317015:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:22747:x1875634419939712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.317022:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788745022.317388:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788745022.317439:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcb55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788745022.317496:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745022.317534:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38982e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788745022.317745:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419939840 00000100:00100000:0.0:1788745022.317751:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419939840 00000100:00100000:0.0:1788745022.317793:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788745022.317801:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:22747:x1875634419939840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788745022.317908:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:22747:x1875634419939840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745022.317915:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788745022.318205:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcb55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788745022.321877:0:25795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788745022.322570:0:22747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788745022.322615:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788745022.322631:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc2a1e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1ee expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.322646:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3a6bf7200/0x6e465a23bbc2a1e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1ee expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788745022.322660:0:22747:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788745022.322674:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce3bda7d000 from 13 10000000:01000000:3.0:1788745022.322698:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788745022.322749:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ee00/0x6e465a23bbc2a1f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.322758:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ee00/0x6e465a23bbc2a1f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.322772:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ee00/0x6e465a23bbc2a1f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745022.322808:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.322919:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745022.322989:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388b67f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788745022.323200:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419939968 00000100:00100000:0.0:1788745022.323211:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419939968 00000100:00100000:0.0:1788745022.323327:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788745022.323349:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+22:22747:x1875634419939968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788745022.323372:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745022.323390:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc2a1fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc2a1f5 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.323422:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc2a1fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc2a1f5 expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.323446:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3a6bf7a00/0x6e465a23bbc2a1fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc2a1f5 expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.323457:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf7a00, rc 0) 00000100:00100000:0.0:1788745022.323519:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419939968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745022.323527:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788745022.324206:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419939968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788745022.324229:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ee00/0x6e465a23bbc2a1f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1fc expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.324239:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ee00/0x6e465a23bbc2a1f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2a1fc expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745022.324386:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.324764:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745022.324815:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388b67f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788745022.324922:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419940096 00000100:00100000:2.0:1788745022.324930:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419940096 00000100:00100000:2.0:1788745022.324996:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788745022.325006:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419940096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788745022.325180:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419940096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745022.325189:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788745022.325350:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.325391:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.325758:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745022.325874:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419940224 00000100:00100000:2.0:1788745022.325880:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419940224 00000100:00100000:2.0:1788745022.325906:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788745022.325912:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419940224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788745022.326011:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419940224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745022.326018:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788745022.330539:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388b67f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788745022.330616:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788745022.331928:0:25796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788745022.332190:0:22747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788745022.332232:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788745022.332275:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ee00/0x6e465a23bbc2a1f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1fc expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.332289:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33ee00/0x6e465a23bbc2a1f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a1fc expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788745022.332302:0:22747:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788745022.332305:0:22747:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ce3ba964000 from 13 10000000:01000000:3.0:1788745022.332309:0:22747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788745022.332361:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc2a203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.332370:0:22747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc2a203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.332381:0:22747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc2a203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745022.332410:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.332509:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745022.332564:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388b67540 going to sleep for 11 seconds 00000100:00100000:1.0:1788745022.332657:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419940352 00000100:00100000:1.0:1788745022.332667:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419940352 00000100:00100000:1.0:1788745022.332727:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788745022.332739:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+23:22747:x1875634419940352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788745022.332758:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788745022.332776:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3b403e800/0x6e465a23bbc2a20a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6e465a23bbc2a203 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.332809:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3b403e800/0x6e465a23bbc2a20a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6e465a23bbc2a203 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.332832:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3b403e800/0x6e465a23bbc2a20a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6e465a23bbc2a203 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.332842:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403e800, rc 0) 00000100:00100000:1.0:1788745022.332890:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:22747:x1875634419940352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745022.332906:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788745022.333596:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788745022.333615:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc2a203 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a20a expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.333625:0:22747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc2a203 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6e465a23bbc2a20a expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745022.333702:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.333747:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745022.333788:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388b67540 going to sleep for 11 seconds 00000100:00100000:1.0:1788745022.333874:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419940480 00000100:00100000:1.0:1788745022.333881:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419940480 00000100:00100000:1.0:1788745022.333925:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788745022.333935:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:22747:x1875634419940480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.334080:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:22747:x1875634419940480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745022.334088:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788745022.335790:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.335871:0:22747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788745022.335985:0:22747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745022.336284:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419940608 00000100:00100000:1.0:1788745022.336294:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419940608 00000100:00100000:1.0:1788745022.336367:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788745022.336379:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:22747:x1875634419940608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.336531:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:22747:x1875634419940608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745022.336538:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788745022.336780:0:22747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce388b67540 going to sleep for 11 seconds 00000100:00100000:3.0:1788745022.336797:0:22747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:22747:1875634419940608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788745022.341426:0:25797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788745022.342162:0:22747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788745022.342193:0:22747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788745022.342207:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc2a203 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a20a expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.342221:0:22747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff9ce3bd33f400/0x6e465a23bbc2a203 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6e465a23bbc2a20a expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.480682:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745022.545186:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788745022.545219:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419940736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788745022.545350:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788745022.546154:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419940736 00000100:00100000:3.0:1788745022.546167:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419940736 00000100:00100000:3.0:1788745022.546294:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788745022.546308:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419940736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788745022.546358:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788745022.546460:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419940736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.546469:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788745022.546592:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419940736:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788745022.546772:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788745022.798004:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745022.798110:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396752896 00000100:00100000:3.0:1788745022.798124:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396752896 00000100:00100000:3.0:1788745022.798222:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 23 00000100:00100000:3.0:1788745022.798287:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+6:18696:x1875634396752896:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788745022.798341:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745022.798370:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e400/0x6e465a23bbc2a211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c0a expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798472:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798491:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798504:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798521:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798527:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798533:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798960:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e600/0x6e465a23bbc2a226 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798972:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e600/0x6e465a23bbc2a226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.798979:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e600/0x6e465a23bbc2a226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788745022.799015:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788745022.799027:0:22750:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788745022.799079:0:22750:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e600/0x6e465a23bbc2a226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799092:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799099:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799107:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799114:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33f000 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:3.0:1788745022.799120:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799128:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799143:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3a1cb7900) 00010000:00010000:3.0:1788745022.799146:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788745022.799153:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799158:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799173:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799179:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799195:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799200:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33e200 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:3.0:1788745022.799203:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799209:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799216:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ce3bce0a300) 00010000:00010000:3.0:1788745022.799218:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788745022.799222:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799402:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e200/0x6e465a23bbc2a21f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788745022.799541:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788745022.799578:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e400/0x6e465a23bbc2a211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c0a expref: 8 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799772:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e600/0x6e465a23bbc2a226 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c0a expref: 7 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.799781:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce3bce0a100) 00010000:00010000:3.0:1788745022.799783:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788745022.799785:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33e600, rc 0) 00000100:00100000:3.0:1788745022.799894:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18696:x1875634396752896:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1660us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.799917:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 23 00000100:00100000:3.0:1788745022.804145:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745022.805830:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396753024 00000100:00100000:0.0:1788745022.805850:0:22762:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396753024 00000100:00100000:3.0:1788745022.805930:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5 00000100:00100000:3.0:1788745022.805947:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18696:x1875634396753024:12345-192.168.201.46@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788745022.806281:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18696:x1875634396753024:12345-192.168.201.46@tcp:900:lhsmtool_posix.0 Request processed in 304us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.806291:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5 00000100:00100000:1.0:1788745022.813807:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745022.813983:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396753280 00000100:00100000:0.0:1788745022.814004:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396753280 00000100:00100000:0.0:1788745022.814068:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 24 00000100:00100000:0.0:1788745022.814080:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18696:x1875634396753280:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788745022.814103:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745022.814128:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a22d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c11 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814219:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814235:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814290:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814307:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814315:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814322:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814450:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6c00/0x6e465a23bbc2a242 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814459:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6c00/0x6e465a23bbc2a242 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814465:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6c00/0x6e465a23bbc2a242 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788745022.814475:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788745022.814613:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814629:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814635:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814642:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf6e00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745022.814646:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814654:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814666:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ce3bce0a100) 00010000:00010000:0.0:1788745022.814670:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745022.814675:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814681:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a234 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814695:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814701:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814707:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814712:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7e00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745022.814721:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814740:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814748:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ce3895e9d00) 00010000:00010000:0.0:1788745022.814751:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745022.814753:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.814759:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a23b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.818434:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a22d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c11 expref: 10 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.818467:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6c00/0x6e465a23bbc2a242 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c11 expref: 9 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.818476:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce3895e9000) 00010000:00010000:0.0:1788745022.818478:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745022.818482:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf6c00, rc 0) 00000100:00100000:0.0:1788745022.818574:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+9:18696:x1875634396753280:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 4494us (4778us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788745022.818583:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 24 00000100:00100000:1.0:1788745022.830463:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745022.830568:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396753408 00000100:00100000:2.0:1788745022.830578:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396753408 00000100:00100000:2.0:1788745022.830644:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 25 00000100:00100000:2.0:1788745022.830654:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+9:18696:x1875634396753408:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788745022.830765:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+9:18696:x1875634396753408:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745022.830772:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 25 00000100:00100000:1.0:1788745022.834566:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745022.834663:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396753536 00000100:00100000:3.0:1788745022.834674:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396753536 00000100:00100000:3.0:1788745022.834750:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 26 00000100:00100000:3.0:1788745022.834761:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+5:18696:x1875634396753536:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788745022.835406:0:25091:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 604us 00000100:00080000:1.0:1788745022.838870:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788745022.868477:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745022.868546:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396753664 00000100:00100000:3.0:1788745022.868556:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396753664 00000100:00100000:3.0:1788745022.868621:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 161 00000100:00100000:3.0:1788745022.868631:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+11:18071:x1875634396753664:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788745022.868649:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745022.868666:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3bd33e400/0x6e465a23bbc2a250 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421c18 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.868696:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3bd33e400/0x6e465a23bbc2a250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c18 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.868717:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3bd33e400/0x6e465a23bbc2a250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c18 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.868747:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33e400, rc 0) 00000100:00100000:3.0:1788745022.868816:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18071:x1875634396753664:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 177us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.868824:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 161 00000100:00100000:1.0:1788745022.887939:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+5:18696:x1875634396753536:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 53164us (53366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745022.887960:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 26 00000100:00100000:2.0:1788745022.895974:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745022.897763:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396753792 00000100:00100000:1.0:1788745022.897778:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396753792 00000100:00100000:1.0:1788745022.897864:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 162 00000100:00100000:1.0:1788745022.897880:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18071:x1875634396753792:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.898103:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18071:x1875634396753792:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 226us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745022.898113:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 162 00000100:00100000:0.0:1788745022.902796:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745022.902876:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396753920 00000100:00100000:2.0:1788745022.902888:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396753920 00000100:00100000:2.0:1788745022.902969:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 27 00000100:00100000:2.0:1788745022.902981:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+9:18702:x1875634396753920:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1788745022.903014:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745022.903045:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2e00/0x6e465a23bbc2a257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c1f expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.903136:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.903152:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.903167:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905438:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905465:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905481:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905539:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905546:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905553:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905559:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f3400 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745022.905563:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905588:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905601:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3a1cb7900) 00000100:00100000:1.0:1788745022.905829:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:2.0:1788745022.905848:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788745022.905855:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905862:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f3400/0x6e465a23bbc2a25e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905877:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905884:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905890:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905896:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3813f2200 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745022.905899:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905906:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.905914:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce3af9f4000) 00010000:00010000:2.0:1788745022.905917:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788745022.905920:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745022.905928:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396754048 00010000:00010000:2.0:1788745022.905940:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2200/0x6e465a23bbc2a265 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745022.905942:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396754048 00010000:00010000:2.0:1788745022.906003:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2e00/0x6e465a23bbc2a257 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c1f expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.906014:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3a1cb7900) 00010000:00010000:2.0:1788745022.906017:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788745022.906021:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3813f2e00/0x6e465a23bbc2a257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c1f expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.906029:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3813f2e00, rc 0) 00000100:00100000:3.0:1788745022.906049:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 163 00000100:00100000:3.0:1788745022.906062:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18071:x1875634396754048:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788745022.906099:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+9:18702:x1875634396753920:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 3119us (3310us total) trans 0 rc 301/301 00000100:00100000:2.0:1788745022.906108:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 27 00000100:00100000:3.0:1788745022.906236:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18071:x1875634396754048:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 176us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.906268:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 163 00000100:00100000:1.0:1788745022.912881:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745022.913000:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745022.913132:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396754176 00000100:00100000:2.0:1788745022.913142:0:22759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396754176 00000100:00100000:3.0:1788745022.913144:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396754304 00000100:00100000:3.0:1788745022.913148:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396754304 00000100:00100000:3.0:1788745022.913185:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 164 00000100:00100000:2.0:1788745022.913185:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 0 00000100:00100000:3.0:1788745022.913194:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+12:18071:x1875634396754304:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788745022.913194:0:22759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d68d9106-f31a-4f98-bd1c-504f18088b76+9:18702:x1875634396754176:12345-192.168.201.46@tcp:700:lfs.0 00010000:00010000:3.0:1788745022.913211:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745022.913230:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ce3bd33e200/0x6e465a23bbc2a26c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa57341394421c26 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745022.913279:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ce3bd33e200/0x6e465a23bbc2a26c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c26 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745022.913291:0:22759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d68d9106-f31a-4f98-bd1c-504f18088b76+9:18702:x1875634396754176:12345-192.168.201.46@tcp:700:lfs.0 Request processed in 98us (423us total) trans 0 rc 0/0 00010000:00010000:3.0:1788745022.913293:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ce3bd33e200/0x6e465a23bbc2a26c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c26 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745022.913299:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 0 00010000:00010000:3.0:1788745022.913302:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33e200, rc 0) 00000100:00100000:3.0:1788745022.913331:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18071:x1875634396754304:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 138us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.913337:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 164 00000100:00100000:2.0:1788745022.916981:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745022.917041:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745022.917172:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396754432 00000100:00100000:3.0:1788745022.917193:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396754432 00000100:00100000:1.0:1788745022.917198:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396754688 00000100:00100000:1.0:1788745022.917204:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396754688 00000100:00100000:3.0:1788745022.917285:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 165 00000100:00100000:1.0:1788745022.917285:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 28 00000100:00100000:1.0:1788745022.917298:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+9:18702:x1875634396754688:12345-192.168.201.46@tcp:36:lfs.0 00000100:00100000:3.0:1788745022.917299:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18071:x1875634396754432:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00010000:00010000:1.0:1788745022.917354:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788745022.917390:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e000/0x6e465a23bbc2a18c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421b93 expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.917414:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3a1cb7900) 00010000:00010000:1.0:1788745022.917420:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788745022.917481:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745022.917489:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18071:x1875634396754432:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 191us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745022.917498:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 165 00010000:00010000:1.0:1788745022.917519:0:22751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 5 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.917529:0:22751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.917568:0:22751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 5 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.917584:0:22751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 5 pid: 22752 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745022.917603:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288271c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22751:1875634419940864:192.168.201.46@tcp:104: 00000100:00100000:1.0:1788745022.917659:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419540 going to sleep for 11 seconds 00000100:00100000:0.0:1788745022.924599:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745022.924673:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396754816 00000100:00100000:2.0:1788745022.924683:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396754816 00010000:00010000:2.0:1788745022.924747:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 6 pid: 22752 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745022.924783:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 15 00000100:00100000:2.0:1788745022.924793:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2393:x1875634396754816:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788745022.924816:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788745022.924823:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 6 pid: 22752 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.924836:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 6 pid: 22752 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.924857:0:22737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3a1cb7900) 00010000:00010000:2.0:1788745022.924863:0:22737:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.924873:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.924879:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745022.924900:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788745022.924953:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2393:x1875634396754816:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 161us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745022.924960:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 15 00010000:00010000:1.0:1788745022.925131:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a1cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c03 expref: 5 pid: 22752 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745022.925148:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288271c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22751:1875634419940864:192.168.201.46@tcp:104: 00010000:00010000:1.0:1788745022.925175:0:22751:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.925184:0:22751:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.925190:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.925212:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.925228:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745022.925236:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788745022.925674:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788745022.927510:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927539:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927551:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788745022.927572:0:22751:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000054dbade1 reply state 000000003ec2aaae transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927584:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927591:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:0.0:1788745022.927594:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788745022.927598:0:22751:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788745022.927605:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788745022.927613:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927619:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927625:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927631:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3b403ea00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745022.927635:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927642:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927663:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3a1cb7900) 00010000:00010000:0.0:1788745022.927665:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745022.927670:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927676:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ea00/0x6e465a23bbc2a273 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788745022.927696:0:22751:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000054dbade1 reply state 000000003ec2aaae transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927704:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745022.927710:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce3a1cb7e00) 00010000:00010000:0.0:1788745022.927712:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788745022.927714:0:22751:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788745022.927820:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+10:18702:x1875634396754688:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 10514us (10766us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788745022.927830:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 28 00000100:00100000:0.0:1788745022.929155:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745022.933127:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396754944 00000100:00100000:1.0:1788745022.933144:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396754944 00000100:00100000:1.0:1788745022.933224:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 166 00000100:00100000:1.0:1788745022.933235:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18071:x1875634396754944:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788745022.933419:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+13:18071:x1875634396754944:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 185us (4269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745022.933428:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 166 00000040:00080000:3.0:1788745022.993110:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788745023.047845:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.048084:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396755072 00000100:00100000:3.0:1788745023.048094:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396755072 00000100:00100000:3.0:1788745023.048157:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 29 00000100:00100000:3.0:1788745023.048167:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+10:18712:x1875634396755072:12345-192.168.201.46@tcp:101:lctl.0 00010000:00010000:3.0:1788745023.048191:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745023.048215:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c2d expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.048310:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f800/0x6e465a23bbc2a28f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.048325:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f800/0x6e465a23bbc2a28f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.048338:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f800/0x6e465a23bbc2a28f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788745023.048411:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788745023.048415:0:22750:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788745023.048449:0:22750:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f800/0x6e465a23bbc2a28f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.048471:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c2d expref: 12 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.048488:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f800/0x6e465a23bbc2a28f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c2d expref: 11 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.048497:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3bce0a300) 00010000:00010000:3.0:1788745023.048500:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788745023.048503:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33f800, rc 0) 00000100:00100000:3.0:1788745023.048562:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+11:18712:x1875634396755072:12345-192.168.201.46@tcp:101:lctl.0 Request processed in 396us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.048568:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 29 00000100:00100000:2.0:1788745023.084823:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745023.084941:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396755200 00000100:00100000:1.0:1788745023.084954:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396755200 00000100:00100000:1.0:1788745023.085030:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 30 00000100:00100000:1.0:1788745023.085043:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+5:18713:x1875634396755200:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1788745023.085071:0:25091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788745023.085100:0:25091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e000/0x6e465a23bbc2a296 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c34 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745023.085187:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fe00/0x6e465a23bbc2a29d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745023.085204:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fe00/0x6e465a23bbc2a29d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745023.085296:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fe00/0x6e465a23bbc2a29d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788745023.085358:0:25091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788745023.085362:0:25091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788745023.085509:0:25091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fe00/0x6e465a23bbc2a29d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745023.085539:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e000/0x6e465a23bbc2a296 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c34 expref: 7 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745023.085563:0:25091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fe00/0x6e465a23bbc2a29d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c34 expref: 6 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745023.085571:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3bce0a300) 00010000:00010000:1.0:1788745023.085574:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788745023.085578:0:25091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403fe00, rc 0) 00000100:00100000:1.0:1788745023.085661:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18713:x1875634396755200:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 618us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745023.085669:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 30 00000100:00100000:0.0:1788745023.097173:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.097285:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396755328 00000100:00100000:3.0:1788745023.097297:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396755328 00000100:00100000:3.0:1788745023.097355:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 31 00000100:00100000:3.0:1788745023.097364:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+6:18713:x1875634396755328:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1788745023.097570:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745023.097593:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a2a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c3b expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097660:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097692:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097713:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097726:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097733:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097739:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097840:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a2b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097848:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a2b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097854:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a2b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788745023.097892:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788745023.097896:0:22750:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788745023.097918:0:22750:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a2b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097930:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097946:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097952:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097959:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33e800 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:3.0:1788745023.097964:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.097971:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.098677:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3bce0a300) 00010000:00010000:3.0:1788745023.098683:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788745023.098690:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099053:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099072:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099078:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099084:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099089:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33fc00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:3.0:1788745023.099105:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099113:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099124:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce3a1cb7e00) 00010000:00010000:3.0:1788745023.099127:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788745023.099130:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099136:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099176:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a2a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c3b expref: 8 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099191:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a2b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c3b expref: 7 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.099198:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:3.0:1788745023.099200:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788745023.099203:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33fa00, rc 0) 00000100:00100000:3.0:1788745023.099378:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+7:18713:x1875634396755328:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 2013us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.099634:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 31 00000100:00100000:2.0:1788745023.105096:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.105181:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396755456 00000100:00100000:0.0:1788745023.105191:0:22762:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396755456 00000100:00100000:0.0:1788745023.105351:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 6 00000100:00100000:0.0:1788745023.105363:0:22762:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:18713:x1875634396755456:12345-192.168.201.46@tcp:900:lfs.0 00000100:00100000:0.0:1788745023.105463:0:22762:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:18713:x1875634396755456:12345-192.168.201.46@tcp:900:lfs.0 Request processed in 102us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745023.105487:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 6 00000100:00080000:1.0:1788745023.109415:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788745023.110715:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745023.110814:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396755712 00000100:00100000:2.0:1788745023.110838:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396755712 00000100:00100000:2.0:1788745023.110971:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 32 00000100:00100000:2.0:1788745023.110981:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+7:18713:x1875634396755712:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1788745023.111002:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745023.111020:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921800/0x6e465a23bbc2a2c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c42 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788745023.111124:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788745023.111237:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921800/0x6e465a23bbc2a2c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c42 expref: 9 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.111292:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3bce0a300) 00010000:00010000:2.0:1788745023.111295:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788745023.111300:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921800/0x6e465a23bbc2a2c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c42 expref: 9 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.111317:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce287921800, rc 0) 00000100:00100000:2.0:1788745023.111383:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+8:18713:x1875634396755712:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 403us (676us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788745023.111391:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 32 00000100:00100000:2.0:1788745023.121681:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.121769:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396755968 00000100:00100000:0.0:1788745023.121780:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396755968 00000100:00100000:0.0:1788745023.121848:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 33 00000100:00100000:0.0:1788745023.121858:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+8:18713:x1875634396755968:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:0.0:1788745023.121914:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788745023.121943:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fa00/0x6e465a23bbc2a2b9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c3b expref: 8 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.121963:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:0.0:1788745023.121969:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788745023.121996:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.122010:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.122020:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788745023.122203:0:22752:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a13bc109 reply state 00000000ed8ba6c0 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.122217:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.122224:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:0.0:1788745023.122226:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788745023.122392:0:22752:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788745023.122402:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788745023.122474:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+9:18713:x1875634396755968:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 617us (801us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788745023.122482:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 33 00000100:00100000:1.0:1788745023.129182:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.129284:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396756224 00000100:00100000:3.0:1788745023.129294:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396756224 00000100:00100000:3.0:1788745023.129348:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 2 00000100:00100000:3.0:1788745023.129358:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+9:18713:x1875634396756224:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:3.0:1788745023.129614:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+10:18713:x1875634396756224:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 256us (439us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788745023.129622:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 2 00000100:00100000:1.0:1788745023.133709:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.134546:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396756480 00000100:00100000:3.0:1788745023.134558:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396756480 00000100:00100000:3.0:1788745023.134621:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 34 00000100:00100000:3.0:1788745023.134631:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+10:18713:x1875634396756480:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1788745023.134657:0:25091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745023.134679:0:25091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a2d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c49 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.134782:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.134799:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.134823:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.134834:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.134841:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.134848:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788745023.134961:0:25091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788745023.135046:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135054:0:25091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135062:0:25091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135068:0:25091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33fc00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:3.0:1788745023.135072:0:25091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135080:0:25091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135092:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3bce0a300) 00010000:00010000:3.0:1788745023.135095:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788745023.135099:0:25091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135106:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a2dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135118:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135125:0:25091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135131:0:25091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135145:0:25091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33e800 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:3.0:1788745023.135148:0:25091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135154:0:25091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135162:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce3a1cb7e00) 00010000:00010000:3.0:1788745023.135165:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788745023.135168:0:25091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135173:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a2e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135221:0:25091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a2d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c49 expref: 12 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135231:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3bce0a300) 00010000:00010000:3.0:1788745023.135234:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788745023.135237:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a2d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c49 expref: 12 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.135624:0:25091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33f000, rc 0) 00000100:00100000:3.0:1788745023.135693:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+11:18713:x1875634396756480:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1062us (1997us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788745023.135702:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 34 00000100:00100000:1.0:1788745023.142238:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.142445:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396756608 00000100:00100000:0.0:1788745023.142457:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396756608 00000100:00100000:0.0:1788745023.142535:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 35 00000100:00100000:0.0:1788745023.142547:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+11:18713:x1875634396756608:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1788745023.142578:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745023.142598:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7c00/0x6e465a23bbc2a2f1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c50 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.142690:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.142704:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.142714:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788745023.142750:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788745023.142753:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788745023.142771:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.142796:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7c00/0x6e465a23bbc2a2f1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.142823:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.142847:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:0.0:1788745023.142850:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788745023.142854:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3a6bf7e00, rc 0) 00000100:00100000:0.0:1788745023.142915:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c925a64-231d-4d66-9b5c-6862a11d831d+12:18713:x1875634396756608:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 369us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745023.142922:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 35 00000100:00100000:1.0:1788745023.146869:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.146989:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396756736 00000100:00100000:3.0:1788745023.147025:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396756736 00000100:00100000:3.0:1788745023.147101:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3 00000100:00100000:3.0:1788745023.147115:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+12:18713:x1875634396756736:12345-192.168.201.46@tcp:37:lfs.0 00000100:00100000:3.0:1788745023.157345:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+12:18713:x1875634396756736:12345-192.168.201.46@tcp:37:lfs.0 Request processed in 10215us (10474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.157364:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3 00000100:00100000:1.0:1788745023.169891:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.170010:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396756992 00000100:00100000:0.0:1788745023.170025:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396756992 00000100:00100000:0.0:1788745023.170100:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 4 00000100:00100000:0.0:1788745023.170110:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac4b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+12:18713:x1875634396756992:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:0.0:1788745023.170412:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac4b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+13:18713:x1875634396756992:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 301us (534us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788745023.170419:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 4 00000100:00100000:1.0:1788745023.262425:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745023.262562:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396757120 00000100:00100000:2.0:1788745023.262573:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396757120 00000100:00100000:2.0:1788745023.262631:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 36 00000100:00100000:2.0:1788745023.262643:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+11:18719:x1875634396757120:12345-192.168.201.46@tcp:101:bash.0 00010000:00010000:2.0:1788745023.262666:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745023.262687:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921800/0x6e465a23bbc2a2ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c57 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262768:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262783:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262794:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262818:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262826:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262833:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262918:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921e00/0x6e465a23bbc2a314 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262928:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921e00/0x6e465a23bbc2a314 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.262936:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921e00/0x6e465a23bbc2a314 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788745023.262972:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788745023.262976:0:22751:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788745023.263027:0:22751:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921e00/0x6e465a23bbc2a314 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263047:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263054:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263062:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263068:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920e00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745023.263072:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263080:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263091:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3bce0a300) 00010000:00010000:2.0:1788745023.263094:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788745023.263099:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263105:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263118:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263123:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263130:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263139:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920000 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745023.263142:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263149:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263155:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce3a1cb7e00) 00010000:00010000:2.0:1788745023.263157:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788745023.263160:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263166:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a30d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263191:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921800/0x6e465a23bbc2a2ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c57 expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263204:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921e00/0x6e465a23bbc2a314 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c57 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.263211:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:2.0:1788745023.263213:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788745023.263216:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce287921e00, rc 0) 00000100:00100000:2.0:1788745023.263348:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+12:18719:x1875634396757120:12345-192.168.201.46@tcp:101:bash.0 Request processed in 707us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745023.263356:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 36 00000100:00100000:1.0:1788745023.267699:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.267792:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396757248 00000100:00100000:0.0:1788745023.267810:0:22762:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396757248 00000100:00100000:0.0:1788745023.267864:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00100000:0.0:1788745023.267873:0:22762:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:18719:x1875634396757248:12345-192.168.201.46@tcp:900:bash.0 00000100:00100000:0.0:1788745023.267945:0:22762:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:18719:x1875634396757248:12345-192.168.201.46@tcp:900:bash.0 Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745023.267953:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00100000:1.0:1788745023.272317:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.272414:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396757504 00000100:00100000:0.0:1788745023.272424:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396757504 00000100:00100000:0.0:1788745023.272485:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 37 00000100:00100000:0.0:1788745023.272494:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+12:18719:x1875634396757504:12345-192.168.201.46@tcp:101:bash.0 00010000:00010000:0.0:1788745023.272533:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745023.272553:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7c00/0x6e465a23bbc2a31b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c5e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.272658:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.272674:0:22752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.272683:0:22752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.272717:0:22752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.272729:0:22752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 12 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745023.272742:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22752:1875634419940992:192.168.201.46@tcp:104: 00000100:00100000:0.0:1788745023.272842:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce393805c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788745023.275443:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.275529:0:25782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396757632 00000100:00100000:3.0:1788745023.275540:0:25782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396757632 00010000:00010000:3.0:1788745023.275580:0:25782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 13 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745023.275622:0:25782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 16 00000100:00100000:3.0:1788745023.275632:0:25782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+13:2392:x1875634396757632:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788745023.275646:0:25782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788745023.275652:0:25782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 13 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.275665:0:25782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 13 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.275688:0:25782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:3.0:1788745023.275693:0:25782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.275704:0:25782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.275712:0:25782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.275745:0:25782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788745023.275798:0:25782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c925a64-231d-4d66-9b5c-6862a11d831d+13:2392:x1875634396757632:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 168us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.275814:0:25782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 16 00010000:00010000:0.0:1788745023.277628:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7e00/0x6e465a23bbc2a2f8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c50 expref: 12 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745023.277653:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22752:1875634419940992:192.168.201.46@tcp:104: 00010000:00010000:0.0:1788745023.277678:0:22752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.277706:0:22752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.277713:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.277777:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.277790:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.277799:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278363:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278375:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278393:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788745023.278405:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788745023.278432:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278439:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278445:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278460:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf7000 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745023.278466:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278474:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278487:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:0.0:1788745023.278490:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745023.278494:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278500:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7000/0x6e465a23bbc2a322 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788745023.278511:0:22752:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000028883e6c reply state 0000000031865805 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278522:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278528:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ce3895e9400) 00010000:00010000:0.0:1788745023.278530:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788745023.278534:0:22752:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788745023.278567:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf7c00/0x6e465a23bbc2a31b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278581:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 14 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.278600:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745023.278602:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788745023.278605:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804ec00, rc 0) 00000100:00100000:0.0:1788745023.278674:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+15:18719:x1875634396757504:12345-192.168.201.46@tcp:101:bash.0 Request processed in 6180us (6368us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788745023.278682:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 37 00000100:00100000:1.0:1788745023.301740:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745023.301840:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396757760 00000100:00100000:2.0:1788745023.301861:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396757760 00000100:00100000:2.0:1788745023.301924:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 38 00000100:00100000:2.0:1788745023.301934:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+15:18719:x1875634396757760:12345-192.168.201.46@tcp:101:bash.0 00010000:00010000:2.0:1788745023.301957:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745023.301979:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a33e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c65 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.302044:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.302056:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.302067:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788745023.302112:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788745023.302116:0:22751:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788745023.302135:0:22751:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.302145:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.302168:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920000/0x6e465a23bbc2a33e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.302186:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 16 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.302195:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:2.0:1788745023.302204:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788745023.302209:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce287920e00, rc 0) 00000100:00100000:2.0:1788745023.302453:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+16:18719:x1875634396757760:12345-192.168.201.46@tcp:101:bash.0 Request processed in 519us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745023.302460:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 38 00000100:00100000:1.0:1788745023.311104:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.311235:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396758016 00000100:00100000:0.0:1788745023.311292:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396758016 00000100:00100000:0.0:1788745023.311371:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5 00000100:00100000:0.0:1788745023.311394:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+16:18719:x1875634396758016:12345-192.168.201.46@tcp:35:bash.0 00000100:00100000:0.0:1788745023.312110:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+17:18719:x1875634396758016:12345-192.168.201.46@tcp:35:bash.0 Request processed in 723us (1017us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788745023.312121:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5 00000100:00100000:1.0:1788745023.430111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.430864:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396758272 00000100:00100000:3.0:1788745023.430883:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396758272 00000100:00100000:3.0:1788745023.430987:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 39 00000100:00100000:3.0:1788745023.431002:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+17:18729:x1875634396758272:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1788745023.431041:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745023.431072:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a34c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c6c expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788745023.431287:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788745023.431471:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a34c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c6c expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.431491:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ce3bce0a300) 00010000:00010000:3.0:1788745023.431494:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788745023.431501:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a34c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c6c expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745023.431520:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33f000, rc 0) 00000100:00100000:3.0:1788745023.431616:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+18:18729:x1875634396758272:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 617us (1524us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788745023.431623:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 39 00000100:00100000:1.0:1788745023.435949:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.436211:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396758528 00000100:00100000:3.0:1788745023.436275:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396758528 00000100:00100000:3.0:1788745023.436352:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 6 00000100:00100000:3.0:1788745023.436364:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+18:18729:x1875634396758528:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:3.0:1788745023.436709:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+19:18729:x1875634396758528:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 344us (776us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788745023.436729:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 6 00000040:00080000:0.0:1788745023.441913:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788745023.489332:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.494144:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396758784 00000100:00100000:3.0:1788745023.494168:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396758784 00000100:00100000:2.0:1788745023.495549:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 40 00000100:00100000:2.0:1788745023.495567:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+19:18732:x1875634396758784:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1788745023.495605:0:25091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745023.495635:0:25091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a35a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c73 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.495830:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920a00/0x6e465a23bbc2a361 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.495850:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920a00/0x6e465a23bbc2a361 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.495866:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920a00/0x6e465a23bbc2a361 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788745023.495881:0:25091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788745023.496386:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a35a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c73 expref: 22 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.496411:0:25091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920a00/0x6e465a23bbc2a361 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c73 expref: 21 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745023.496421:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:2.0:1788745023.496424:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788745023.496448:0:25091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce287920a00, rc 0) 00000100:00100000:2.0:1788745023.496547:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+21:18732:x1875634396758784:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 984us (7233us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788745023.496556:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 40 00000100:00100000:3.0:1788745023.509477:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.509554:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.509724:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396758912 00000100:00100000:0.0:1788745023.509740:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396758912 00000100:00100000:0.0:1788745023.509858:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 41 00000100:00100000:0.0:1788745023.509873:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+21:18732:x1875634396758912:12345-192.168.201.46@tcp:54:lfs.0 00010000:00010000:0.0:1788745023.510004:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510029:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510047:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510124:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510133:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510141:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510148:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804fe00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745023.510154:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510162:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510180:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745023.510184:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788745023.510191:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.510197:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a36f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745023.510345:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+21:18732:x1875634396758912:12345-192.168.201.46@tcp:54:lfs.0 Request processed in 475us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745023.510355:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 41 00000100:00100000:1.0:1788745023.510632:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396759040 00000100:00100000:1.0:1788745023.510640:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396759040 00000100:00100000:1.0:1788745023.510707:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 0 00000100:00100000:1.0:1788745023.510728:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+21:2395:x1875634396759040:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788745023.510743:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788745023.510763:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920a00/0x6e465a23bbc2a361 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c73 expref: 21 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745023.510776:0:22737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:1.0:1788745023.510780:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788745023.510818:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+20:2395:x1875634396759040:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 104us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745023.510826:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 0 00000100:00100000:1.0:1788745023.515084:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.515422:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396759296 00000100:00100000:3.0:1788745023.515440:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396759296 00000100:00100000:3.0:1788745023.515514:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7 00000100:00100000:3.0:1788745023.515527:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+20:18732:x1875634396759296:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:3.0:1788745023.516792:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+21:18732:x1875634396759296:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 1258us (1715us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788745023.516816:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7 00010000:00010000:0.0:1788745023.519854:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745023.557415:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745023.557469:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745023.557514:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745023.557554:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745023.557592:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396759680 00000100:00100000:1.0:1788745023.557605:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396759680 00000100:00100000:2.0:1788745023.557810:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396759424 00000100:00100000:2.0:1788745023.557816:0:22742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396759424 00000100:00100000:2.0:1788745023.557861:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 167 00000100:00100000:2.0:1788745023.557874:0:22742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:2394:x1875634396759424:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788745023.557967:0:22742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac12b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89bd4431-e5bd-4a95-a183-977432e8cc17+13:2394:x1875634396759424:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 95us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745023.557976:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 167 00000100:00080000:2.0:1788745023.558060:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788745023.558109:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745023.564867:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396759936 00000100:00100000:1.0:1788745023.564888:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396759936 00000100:00100000:3.0:1788745023.567484:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396759552 00000100:00100000:3.0:1788745023.567506:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396759552 00000100:00100000:3.0:1788745023.567569:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396759808 00000100:00100000:3.0:1788745023.567573:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396759808 00000100:00100000:3.0:1788745023.567601:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 19 00000100:00100000:3.0:1788745023.567613:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2394:x1875634396759680:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745023.567755:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2394:x1875634396759680:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 143us (10283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.567764:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 19 00000100:00100000:3.0:1788745023.567787:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 20 00000100:00100000:3.0:1788745023.567826:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bed3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2394:x1875634396759936:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745023.567859:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bed3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2394:x1875634396759936:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 35us (10345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.567866:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 20 00000100:00100000:3.0:1788745023.568391:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:3.0:1788745023.568400:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2394:x1875634396759552:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745023.568436:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2394:x1875634396759552:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 37us (10881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.568442:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:3.0:1788745023.568456:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 22 00000100:00100000:3.0:1788745023.568464:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2394:x1875634396759808:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745023.568489:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2394:x1875634396759808:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 27us (10380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.568495:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 22 00000100:00080000:3.0:1788745023.568764:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788745023.568771:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788745023.577692:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788745023.577732:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419941120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788745023.577779:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788745023.577793:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419941248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788745023.577842:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745023.578214:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788745023.578298:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419941120 00000100:00100000:3.0:1788745023.578309:0:24263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419941120 00000100:00100000:3.0:1788745023.578397:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788745023.578408:0:24263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419941120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788745023.578440:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00080000:2.0:1788745023.581397:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788745023.581437:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce288291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419941376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788745023.582785:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745023.582922:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419941248 00000100:00100000:0.0:1788745023.582937:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419941248 00000100:00100000:0.0:1788745023.585304:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788745023.585337:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419941248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788745023.585403:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788745023.585602:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419941248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788745023.585754:0:24263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419941120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7344us (7910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745023.585766:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788745023.585879:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419941248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 557us (3100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745023.585888:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788745023.585956:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419941120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788745023.587092:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745023.591959:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419941376 00000100:00100000:1.0:1788745023.591982:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419941376 00000100:00100000:1.0:1788745023.592175:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788745023.592191:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419941376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788745023.592280:0:23766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788745023.593617:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419941376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1423us (6521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745023.593631:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788745023.594711:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce288291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419941376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788745023.889127:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.889531:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396760192 00000100:00100000:0.0:1788745023.889546:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396760192 00000100:00100000:0.0:1788745023.889632:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 42 00000100:00100000:0.0:1788745023.889645:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+21:18763:x1875634396760192:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1788745023.889681:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745023.889707:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a376 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c7a expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.890058:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a37d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.890078:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a37d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.890094:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a37d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788745023.890111:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788745023.890425:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a376 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c7a expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.890473:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a37d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c7a expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.891920:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745023.891936:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788745023.891943:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804f400, rc 0) 00000100:00100000:0.0:1788745023.892185:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+23:18763:x1875634396760192:12345-192.168.201.46@tcp:101:cat.0 Request processed in 2535us (3065us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788745023.892197:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 42 00000100:00100000:3.0:1788745023.902982:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745023.903184:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745023.903670:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396760576 00000100:00100000:1.0:1788745023.903684:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396760576 00000100:00100000:1.0:1788745023.903770:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8 00000100:00100000:1.0:1788745023.903783:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+23:18763:x1875634396760576:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:1.0:1788745023.904411:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+24:18763:x1875634396760576:12345-192.168.201.46@tcp:35:cat.0 Request processed in 627us (1223us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788745023.904420:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8 00000100:00100000:0.0:1788745023.905379:0:25782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396760320 00000100:00100000:0.0:1788745023.905393:0:25782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396760320 00000100:00100000:0.0:1788745023.905459:0:25782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1 00000100:00100000:0.0:1788745023.905487:0:25782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+24:2392:x1875634396760320:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788745023.905504:0:25782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788745023.905536:0:25782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a37d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c7a expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.905561:0:25782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745023.905567:0:25782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788745023.905630:0:25782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+23:2392:x1875634396760320:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 162us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745023.905638:0:25782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1 00000100:00100000:3.0:1788745023.997615:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745023.997838:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396760832 00000100:00100000:0.0:1788745023.997852:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396760832 00000100:00100000:0.0:1788745023.997943:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 43 00000100:00100000:0.0:1788745023.997978:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+23:18769:x1875634396760832:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1788745023.998018:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745023.998048:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a38b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c81 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.998205:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.998222:0:22752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.998233:0:22752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.998242:0:22752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.998327:0:22752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.998343:0:22752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 24 pid: 22751 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745023.998358:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22752:1875634419941504:192.168.201.46@tcp:104: 00010000:00010000:0.0:1788745023.998498:0:22752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745023.998508:0:22752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 24 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745023.998525:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22752:1875634419941632:192.168.201.46@tcp:104: 00000100:00100000:0.0:1788745023.998555:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce287884b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788745024.001088:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745024.001184:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745024.001306:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396760960 00000100:00100000:1.0:1788745024.001318:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396760960 00010000:00010000:1.0:1788745024.001383:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 25 pid: 22751 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745024.001441:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396761088 00000100:00100000:1.0:1788745024.001444:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396761088 00010000:00010000:1.0:1788745024.001463:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 26 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745024.001482:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 17 00000100:00100000:1.0:1788745024.001491:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+26:2392:x1875634396760960:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788745024.001507:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788745024.001513:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 26 pid: 22751 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001526:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 26 pid: 22751 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001553:0:22737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:1.0:1788745024.001560:0:22737:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001570:0:22737:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001577:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788745024.001637:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+26:2392:x1875634396760960:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 146us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745024.001644:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 17 00000100:00100000:1.0:1788745024.001665:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 18 00000100:00100000:1.0:1788745024.001673:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+25:2392:x1875634396761088:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788745024.001688:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788745024.001693:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 25 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001702:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 25 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001714:0:22737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:1.0:1788745024.001717:0:22737:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001726:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001733:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745024.001754:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788745024.001770:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+25:2392:x1875634396761088:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 99us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745024.001776:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 18 00000100:00080000:3.0:1788745024.002115:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788745024.009990:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a345 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c65 expref: 24 pid: 22751 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745024.010028:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22752:1875634419941504:192.168.201.46@tcp:104: 00010000:00010000:0.0:1788745024.010045:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a330 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c5e expref: 23 pid: 22752 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745024.010058:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22752:1875634419941632:192.168.201.46@tcp:104: 00010000:00010000:0.0:1788745024.010095:0:22752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.010108:0:22752:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.010115:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788745024.010148:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788745024.010451:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a38b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c81 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.010469:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fe00/0x6e465a23bbc2a392 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c81 expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.010504:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745024.010507:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788745024.010512:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804fe00, rc 0) 00000100:00100000:0.0:1788745024.010608:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+23:18769:x1875634396760832:12345-192.168.201.46@tcp:101:dd.0 Request processed in 12631us (13008us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788745024.010619:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 43 00000100:00100000:3.0:1788745024.015677:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745024.015779:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396761216 00000100:00100000:0.0:1788745024.015801:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396761216 00000100:00100000:0.0:1788745024.015879:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 44 00000100:00100000:0.0:1788745024.015893:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+23:18769:x1875634396761216:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1788745024.015928:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745024.015957:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e600/0x6e465a23bbc2a3a0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c88 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.016002:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.016020:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.016034:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.016196:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e600/0x6e465a23bbc2a3a0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 25 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.016219:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.016240:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745024.016294:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788745024.016300:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804e400, rc 0) 00000100:00100000:0.0:1788745024.016376:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+24:18769:x1875634396761216:12345-192.168.201.46@tcp:101:dd.0 Request processed in 485us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745024.016384:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 44 00000040:00080000:3.0:1788745024.024311:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788745024.024966:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745024.025195:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396761472 00000100:00100000:3.0:1788745024.025207:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396761472 00000100:00100000:3.0:1788745024.025317:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 45 00000100:00100000:3.0:1788745024.025331:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+24:18769:x1875634396761472:12345-192.168.201.46@tcp:36:dd.0 00010000:00010000:3.0:1788745024.025659:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745024.025683:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745024.025697:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788745024.025755:0:25091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788745024.025782:0:25091:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005cca9c07 reply state 00000000997a978e transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745024.025809:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745024.025817:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:3.0:1788745024.025839:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788745024.025844:0:25091:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788745024.025977:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+27:18769:x1875634396761472:12345-192.168.201.46@tcp:36:dd.0 Request processed in 647us (1018us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788745024.025985:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 45 00000020:00080000:3.0:1788745024.025992:0:25091:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788745024.034633:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745024.034766:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396761600 00000100:00100000:0.0:1788745024.034780:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396761600 00000100:00100000:0.0:1788745024.034873:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 46 00000100:00100000:0.0:1788745024.034886:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+27:18769:x1875634396761600:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1788745024.034923:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745024.034954:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e600/0x6e465a23bbc2a3b5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c8f expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.035033:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e600/0x6e465a23bbc2a3b5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c8f expref: 28 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.035050:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e600/0x6e465a23bbc2a3b5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c8f expref: 28 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.035071:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745024.035074:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788745024.035079:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804e600, rc 0) 00000100:00100000:0.0:1788745024.035163:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+28:18769:x1875634396761600:12345-192.168.201.46@tcp:101:dd.0 Request processed in 279us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745024.035171:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 46 00000100:00100000:1.0:1788745024.072204:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745024.072359:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396761856 00000100:00100000:2.0:1788745024.072373:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396761856 00000100:00100000:2.0:1788745024.072458:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 2 00000100:00100000:2.0:1788745024.072470:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+28:18769:x1875634396761856:12345-192.168.201.46@tcp:103:dd.0 00010000:00010000:2.0:1788745024.072490:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788745024.072525:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e600/0x6e465a23bbc2a3b5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c8f expref: 28 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745024.072550:0:22737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:2.0:1788745024.072579:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788745024.072654:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+27:18769:x1875634396761856:12345-192.168.201.46@tcp:103:dd.0 Request processed in 185us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745024.072663:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 2 00000100:00100000:3.0:1788745024.075630:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745024.076004:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396761984 00000100:00100000:2.0:1788745024.076017:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396761984 00000100:00100000:2.0:1788745024.076092:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 47 00000100:00100000:2.0:1788745024.076104:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+27:18769:x1875634396761984:12345-192.168.201.46@tcp:58:dd.0 00010000:00010000:2.0:1788745024.076285:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745024.076309:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745024.076325:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788745024.090099:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788745024.090150:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788745024.090673:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788745024.090968:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+27:18769:x1875634396761984:12345-192.168.201.46@tcp:58:dd.0 Request processed in 14856us (15344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745024.090982:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 47 00000100:00100000:3.0:1788745024.101165:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745024.101350:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396762112 00000100:00100000:0.0:1788745024.101369:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396762112 00000100:00100000:0.0:1788745024.101484:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 48 00000100:00100000:0.0:1788745024.101510:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+27:18769:x1875634396762112:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1788745024.101553:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745024.101591:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c96 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.101689:0:22750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.101705:0:22750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c96 expref: 28 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.102183:0:22750:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.102205:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c96 expref: 28 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.102220:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745024.102224:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788745024.102228:0:22750:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c96 expref: 28 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745024.102236:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804f400, rc 0) 00000100:00100000:0.0:1788745024.102374:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+28:18769:x1875634396762112:12345-192.168.201.46@tcp:101:dd.0 Request processed in 868us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745024.102383:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 48 00010000:00010000:0.0:1788745024.529371:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788745025.043268:0:22786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788745025.043283:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788745025.043373:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788745025.043387:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788745025.043586:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcf7f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22786:1875634419941760:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788745025.043731:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3bd509240 going to sleep for 11 seconds 00000100:00100000:2.0:1788745025.050890:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcf7f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22786:1875634419941760:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788745025.055891:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.059745:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396762240 00000100:00100000:0.0:1788745025.059781:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396762240 00000100:00100000:0.0:1788745025.059899:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 49 00000100:00100000:0.0:1788745025.059913:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+28:18770:x1875634396762240:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788745025.059961:0:22752:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788745025.060606:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+28:18770:x1875634396762240:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 693us (4728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745025.060617:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 49 00000100:00100000:3.0:1788745025.074473:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.074908:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396762368 00000100:00100000:0.0:1788745025.074928:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396762368 00000100:00100000:0.0:1788745025.075028:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 50 00000100:00100000:0.0:1788745025.075040:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcf7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+28:18770:x1875634396762368:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788745025.075117:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075134:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075150:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075167:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075174:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075181:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075231:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075240:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075293:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788745025.075343:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788745025.075347:0:22750:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788745025.075361:0:22750:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075371:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075377:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075397:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075403:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804ec00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.075406:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075414:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075424:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce3895e9000) 00010000:00010000:0.0:1788745025.075433:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745025.075439:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075445:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a3ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075462:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075468:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075473:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075478:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804f600 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.075480:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075485:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075492:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9ce3895e9600) 00010000:00010000:0.0:1788745025.075494:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745025.075496:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075501:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075514:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075525:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075530:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075535:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804e000 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.075538:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075543:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075551:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745025.075553:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745025.075556:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.075561:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788745025.075651:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcf7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+28:18770:x1875634396762368:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 613us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745025.075659:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 50 00000100:00100000:1.0:1788745025.080967:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.081535:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396762624 00000100:00100000:2.0:1788745025.081551:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396762624 00000100:00100000:2.0:1788745025.081638:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 51 00000100:00100000:2.0:1788745025.081653:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+28:18770:x1875634396762624:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788745025.081898:0:25091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745025.081930:0:25091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a3df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421c9d expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.082181:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.082545:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.082564:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788745025.082585:0:25091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788745025.084217:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084236:0:25091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084274:0:25091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084282:0:25091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920e00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745025.084288:0:25091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084299:0:25091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084321:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:2.0:1788745025.084340:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788745025.084359:0:25091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084366:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a3e6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084452:0:25091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a3df lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c9d expref: 30 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084464:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ce3895e9000) 00010000:00010000:2.0:1788745025.084467:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788745025.084471:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a3df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c9d expref: 30 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.084483:0:25091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce287921c00, rc 0) 00000100:00100000:2.0:1788745025.084582:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+29:18770:x1875634396762624:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2932us (3632us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788745025.084593:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 51 00000100:00100000:3.0:1788745025.097088:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.097294:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396762752 00000100:00100000:0.0:1788745025.097310:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396762752 00000100:00100000:0.0:1788745025.097398:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 52 00000100:00100000:0.0:1788745025.097422:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+29:18770:x1875634396762752:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788745025.097482:0:22750:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788745025.097849:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+29:18770:x1875634396762752:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 415us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.097863:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 52 00000100:00100000:3.0:1788745025.107908:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.108120:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396763008 00000100:00100000:0.0:1788745025.108135:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396763008 00000100:00100000:0.0:1788745025.112345:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 53 00000100:00100000:0.0:1788745025.112384:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+29:18770:x1875634396763008:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788745025.112428:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745025.112460:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3f4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421ca4 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788745025.113055:0:22752:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:0.0:1788745025.113063:0:22752:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1788745025.113099:0:22752:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1788745025.113328:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3fb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.113348:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.113362:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.113438:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a3f4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421ca4 expref: 32 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.113461:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421ca4 expref: 31 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.113471:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3895e9600) 00010000:00010000:0.0:1788745025.113474:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788745025.113479:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804f600, rc 0) 00000100:00100000:0.0:1788745025.113604:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+31:18770:x1875634396763008:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1241us (5711us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1788745025.113613:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 53 00000100:00100000:3.0:1788745025.127750:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.127842:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396763264 00000100:00100000:2.0:1788745025.127857:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396763264 00000100:00100000:2.0:1788745025.128015:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 54 00000100:00100000:2.0:1788745025.128029:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+31:18770:x1875634396763264:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788745025.128116:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788745025.128153:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f600/0x6e465a23bbc2a3fb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421ca4 expref: 31 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.128180:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3895e9600) 00010000:00010000:2.0:1788745025.128212:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788745025.128322:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.128341:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.128354:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.128372:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.128380:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.128387:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.129912:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.129935:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.129944:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.129951:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921c00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745025.129958:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.129967:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130009:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:2.0:1788745025.130012:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788745025.130020:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130027:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921c00/0x6e465a23bbc2a409 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130048:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130055:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130061:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130067:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920e00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745025.130071:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130077:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130085:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xe68b2c7d (ffff9ce3af9f4000) 00010000:00010000:2.0:1788745025.130088:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788745025.130091:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.130098:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a410 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe68b2c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745025.130282:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+30:18770:x1875634396763264:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 2250us (2541us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788745025.130292:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 54 00000100:00100000:3.0:1788745025.132393:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745025.140652:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396763392 00000100:00100000:1.0:1788745025.140834:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396763392 00000100:00100000:1.0:1788745025.141036:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 55 00000100:00100000:1.0:1788745025.141050:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+30:18770:x1875634396763392:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788745025.141079:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788745025.141111:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ee00/0x6e465a23bbc2a417 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421cab expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.141159:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f000/0x6e465a23bbc2a41e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.141176:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f000/0x6e465a23bbc2a41e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.141190:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f000/0x6e465a23bbc2a41e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.141384:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403ee00/0x6e465a23bbc2a417 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cab expref: 32 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.141409:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f000/0x6e465a23bbc2a41e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cab expref: 31 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.141420:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:1.0:1788745025.141423:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788745025.141428:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403f000, rc 0) 00000100:00100000:1.0:1788745025.141729:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+31:18770:x1875634396763392:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 681us (9346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.141737:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 55 00000100:00100000:3.0:1788745025.147862:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.148000:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396763648 00000100:00100000:0.0:1788745025.148015:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396763648 00000100:00100000:0.0:1788745025.148098:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 56 00000100:00100000:0.0:1788745025.148112:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+31:18770:x1875634396763648:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788745025.148335:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.148368:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.148383:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788745025.149071:0:22752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788745025.149086:0:22752:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 750091840148ns, next at 751091836706ns, rc = 0 00000004:00010000:0.0:1788745025.149152:0:22752:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003f7b1c19 reply state 0000000070a91485 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.149169:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.149179:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:0.0:1788745025.149182:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788745025.149188:0:22752:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788745025.151367:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+33:18770:x1875634396763648:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 3238us (3498us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788745025.151380:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 56 00000100:00100000:3.0:1788745025.162946:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.163809:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396763776 00000100:00100000:2.0:1788745025.163825:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396763776 00000100:00100000:2.0:1788745025.163916:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 57 00000100:00100000:2.0:1788745025.163929:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+33:18770:x1875634396763776:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788745025.163972:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788745025.164004:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421cb2 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.164092:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 34 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.164111:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 34 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.164135:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:2.0:1788745025.164139:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788745025.164144:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce287920e00, rc 0) 00000100:00100000:2.0:1788745025.165177:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+34:18770:x1875634396763776:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1238us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.166122:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 57 00000100:00100000:3.0:1788745025.170593:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745025.170807:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396763904 00000100:00100000:1.0:1788745025.170840:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396763904 00000100:00100000:1.0:1788745025.170950:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 23 00000100:00100000:1.0:1788745025.170971:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3a6bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2393:x1875634396763904:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788745025.171041:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788745025.171365:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3a6bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2393:x1875634396763904:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 404us (784us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788745025.171373:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 23 00000100:00100000:3.0:1788745025.178833:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745025.179310:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396764160 00000100:00100000:1.0:1788745025.179326:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396764160 00000100:00100000:1.0:1788745025.179423:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 9 00000100:00100000:1.0:1788745025.179436:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+34:18770:x1875634396764160:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788745025.179775:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+35:18770:x1875634396764160:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 334us (950us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1788745025.179785:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 9 00000100:00100000:3.0:1788745025.184360:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745025.186078:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396764416 00000100:00100000:1.0:1788745025.186097:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396764416 00000100:00100000:1.0:1788745025.186203:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 58 00000100:00100000:1.0:1788745025.186217:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+35:18770:x1875634396764416:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788745025.186421:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+35:18770:x1875634396764416:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 206us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.186429:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 58 00000100:00100000:3.0:1788745025.190415:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.194989:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396764544 00000100:00100000:0.0:1788745025.195015:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396764544 00000100:00100000:0.0:1788745025.195138:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 59 00000100:00100000:0.0:1788745025.195151:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+35:18770:x1875634396764544:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788745025.195182:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745025.195211:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a433 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421cb9 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.195365:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fa00/0x6e465a23bbc2a43a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.195394:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fa00/0x6e465a23bbc2a43a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.195423:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fa00/0x6e465a23bbc2a43a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788745025.195492:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788745025.195516:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fa00/0x6e465a23bbc2a43a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.195549:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804ec00/0x6e465a23bbc2a433 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb9 expref: 37 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.195574:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fa00/0x6e465a23bbc2a43a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb9 expref: 36 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.195583:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:0.0:1788745025.195586:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788745025.195591:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804fa00, rc 0) 00000100:00100000:0.0:1788745025.195713:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+36:18770:x1875634396764544:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 563us (5321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745025.195721:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 59 00000100:00100000:3.0:1788745025.205577:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.206014:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396764672 00000100:00100000:0.0:1788745025.206028:0:24261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396764672 00000100:00100000:0.0:1788745025.206104:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 24 00000100:00100000:0.0:1788745025.206119:0:24261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2395:x1875634396764672:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788745025.206145:0:24261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788745025.206176:0:24261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421cc0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788745025.206209:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1541, blocks: 0x0 00010000:00010000:0.0:1788745025.206292:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1788745025.206298:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788745025.206309:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 7 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.206332:0:24261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 7 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.206350:0:24261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce28804f800, rc 0) 00000100:00100000:0.0:1788745025.207859:0:24261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+7:2395:x1875634396764672:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1730us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745025.207872:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 24 00000100:00100000:1.0:1788745025.212857:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745025.212959:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396764928 00000100:00100000:3.0:1788745025.212974:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396764928 00000100:00100000:3.0:1788745025.213060:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 60 00000100:00100000:3.0:1788745025.213072:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+36:18770:x1875634396764928:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788745025.213274:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+36:18770:x1875634396764928:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 174us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745025.213284:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 60 00000100:00100000:3.0:1788745025.225802:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.226313:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396765056 00000100:00100000:2.0:1788745025.226329:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396765056 00000100:00100000:2.0:1788745025.226440:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 61 00000100:00100000:2.0:1788745025.226475:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+36:18770:x1875634396765056:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788745025.235776:0:22730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788745025.235794:0:22730:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788745025.236119:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236142:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236149:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236155:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3b403fa00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.236160:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236169:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236186:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ce3a1cb7e00) 00010000:00010000:0.0:1788745025.236190:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745025.236195:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236202:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403fa00/0x6e465a23bbc2a27a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236224:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236230:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236297:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236302:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf6e00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.236311:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236317:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236326:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:0.0:1788745025.236328:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745025.236331:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236337:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6e00/0x6e465a23bbc2a281 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236416:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236424:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236430:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236435:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804fc00 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.236439:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236445:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236497:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ce3895e9400) 00010000:00010000:0.0:1788745025.236501:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745025.236550:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236556:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fc00/0x6e465a23bbc2a329 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236589:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236595:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236603:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236624:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3bd33e800 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.236627:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236633:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236641:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:0.0:1788745025.236643:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788745025.236647:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236652:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33e800/0x6e465a23bbc2a3ae lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236664:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236678:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236683:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236688:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804e000 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.236691:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236697:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236706:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:0.0:1788745025.236708:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788745025.236711:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.236716:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e000/0x6e465a23bbc2a425 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788745025.237018:0:22730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1788745025.237143:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.237151:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.237157:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.237162:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3a6bf6000 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:0.0:1788745025.237172:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.237178:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.237188:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ce3895e9d00) 00010000:00010000:0.0:1788745025.237190:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788745025.237193:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.237199:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3a6bf6000/0x6e465a23bbc2a2ce lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745025.238120:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788745025.238168:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419941888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788745025.238392:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745025.238802:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419941888 00000100:00100000:2.0:1788745025.238813:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419941888 00000100:00100000:2.0:1788745025.238885:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788745025.238895:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419941888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788745025.239310:0:24258:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788745025.239314:0:24258:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788745025.239316:0:24258:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788745025.239318:0:24258:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788745025 -> 1788745025 00002000:00010000:2.0:1788745025.239321:0:24258:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788745025.239379:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1875634419941888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 486us (987us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788745025.239387:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1788745025.239433:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ce3bcb56d80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788745025.239439:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419941888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788745025.239945:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+15:18770:x1875634396765056:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 13462us (14146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.239960:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 61 00000100:00080000:3.0:1788745025.240053:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788745025.251330:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745025.251624:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396765184 00000100:00100000:3.0:1788745025.251643:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396765184 00000100:00100000:3.0:1788745025.251712:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 26 00000100:00100000:3.0:1788745025.251726:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+7:2393:x1875634396765184:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788745025.251891:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+7:2393:x1875634396765184:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 167us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745025.251899:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 26 00000100:00100000:0.0:1788745025.258363:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745025.258508:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396765440 00000100:00100000:3.0:1788745025.258524:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396765440 00000100:00100000:3.0:1788745025.258609:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 62 00000100:00100000:3.0:1788745025.258621:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+15:18770:x1875634396765440:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788745025.258704:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788745025.258736:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804fa00/0x6e465a23bbc2a43a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb9 expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.258757:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:3.0:1788745025.258775:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788745025.258814:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a448 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.258829:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a448 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.258851:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a448 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788745025.259290:0:22750:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000ad18f649 reply state 0000000089ffad07 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a448 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.259306:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f000/0x6e465a23bbc2a448 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.259312:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:3.0:1788745025.259315:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788745025.259317:0:22750:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788745025.259500:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+16:18770:x1875634396765440:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 880us (1150us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788745025.259509:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 62 00000100:00100000:1.0:1788745025.266583:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.269664:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396765568 00000100:00100000:0.0:1788745025.269679:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396765568 00000100:00100000:1.0:1788745025.269954:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 27 00000100:00100000:1.0:1788745025.269967:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+7:18770:x1875634396765568:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788745025.269988:0:24260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788745025.270014:0:24260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421cc7 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.270048:0:24260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 8 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.270068:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788745025.270072:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788745025.270078:0:24260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 8 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.270113:0:24260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 8 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.270128:0:24260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 8 pid: 24261 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745025.270141:0:24260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24260:1875634419942016:192.168.201.46@tcp:104: 00000100:00100000:1.0:1788745025.270231:0:24260:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3924196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788745025.274193:0:24260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24260:1875634419942016:192.168.201.46@tcp:104: 00010000:00010000:0.0:1788745025.274238:0:24260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 8 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.274286:0:24260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3b403e000, rc 0) 00000100:00100000:0.0:1788745025.274347:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+8:18770:x1875634396765568:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 4383us (7773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745025.274357:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 27 00000100:00100000:0.0:1788745025.278694:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745025.278804:0:25782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396765696 00000100:00100000:1.0:1788745025.278816:0:25782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396765696 00010000:00010000:1.0:1788745025.278865:0:25782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 8 pid: 24261 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745025.278929:0:25782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 19 00000100:00100000:1.0:1788745025.278939:0:25782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+8:2392:x1875634396765696:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788745025.278955:0:25782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788745025.278981:0:25782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 8 pid: 24261 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.278994:0:25782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 8 pid: 24261 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.279020:0:25782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea091e15/0x6e465a23bbc2a441 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc0 expref: 8 pid: 24261 timeout: 850 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.279038:0:25782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788745025.279043:0:25782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788745025.279050:0:25782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 7 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.279062:0:25782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 7 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.279100:0:25782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 7 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745025.279128:0:25782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25782:1875634419942144:192.168.201.46@tcp:105: 00000100:00100000:1.0:1788745025.279218:0:25782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788745025.285747:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.286189:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396765824 00000100:00100000:0.0:1788745025.286205:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396765824 00000100:00100000:0.0:1788745025.286321:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 28 00000100:00100000:0.0:1788745025.286334:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+8:2392:x1875634396765824:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788745025.286521:0:24738:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788745025.286525:0:24738:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788745024 00002000:00010000:0.0:1788745025.286527:0:24738:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788745023 00002000:00010000:0.0:1788745025.286529:0:24738:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788745025 -> 1788745024 00002000:00010000:0.0:1788745025.286531:0:24738:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788745025.286607:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+9:2392:x1875634396765824:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 275us (1236us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788745025.286615:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 28 00000100:00100000:1.0:1788745025.287178:0:25782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25782:1875634419942144:192.168.201.46@tcp:105: 00010000:00010000:1.0:1788745025.287209:0:25782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788745025.287286:0:25782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+8:2392:x1875634396765696:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 8349us (8603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.287295:0:25782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 19 00000100:00100000:3.0:1788745025.290208:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.294626:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396765952 00000100:00100000:2.0:1788745025.294641:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396765952 00000100:00100000:2.0:1788745025.294779:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 29 00000100:00100000:2.0:1788745025.294791:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+8:2393:x1875634396765952:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788745025.294839:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.294858:0:24258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 8 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.294865:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788745025.294881:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788745025.294885:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.294923:0:24258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 8 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.294943:0:24258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 8 pid: 24260 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745025.294956:0:24258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3bcb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24258:1875634419942272:192.168.201.46@tcp:104: 00000100:00100000:2.0:1788745025.295061:0:24258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce38982e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788745025.306458:0:24258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3bcb57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24258:1875634419942272:192.168.201.46@tcp:104: 00010000:00010000:2.0:1788745025.306491:0:24258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745025.308604:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.309467:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396766080 00000100:00100000:2.0:1788745025.309479:0:22737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396766080 00010000:00010000:2.0:1788745025.309522:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 9 pid: 24260 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745025.309663:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 20 00000100:00100000:2.0:1788745025.309682:0:22737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+9:2393:x1875634396766080:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788745025.309703:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788745025.309733:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 9 pid: 24260 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.309773:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 9 pid: 24260 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.309799:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b1914eb/0x6e465a23bbc2a44f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cc7 expref: 9 pid: 24260 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.309820:0:22737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788745025.309825:0:22737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788745025.309831:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.309843:0:22737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.309884:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788745025.309945:0:22737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+8:2393:x1875634396766080:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 264us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.309953:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 20 00010000:00010000:3.0:1788745025.310298:0:24258:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.310309:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.310330:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.310339:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.310354:0:24258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.310361:0:24258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921c00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:3.0:1788745025.310365:0:24258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.310373:0:24258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.310384:0:24258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.310392:0:24258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a71ea08/0x6e465a23bbc2a456 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788745025.310466:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+7:2393:x1875634396765952:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 15676us (20267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745025.310474:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 29 00000100:00100000:3.0:1788745025.317209:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1788745025.317564:0:25091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396766336 00000100:00100000:0.0:1788745025.319183:0:25091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396766336 00000100:00100000:1.0:1788745025.320119:0:25091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 63 00000100:00100000:1.0:1788745025.320138:0:25091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3be9d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+16:18770:x1875634396766336:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788745025.320236:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.320276:0:25091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 16 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.320285:0:25091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.320326:0:25091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 16 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.320340:0:25091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 16 pid: 22750 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745025.320433:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25091:1875634419942400:192.168.201.46@tcp:104: 00000100:00100000:1.0:1788745025.320546:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788745025.326403:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.327199:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396766464 00000100:00100000:2.0:1788745025.327211:0:22735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396766464 00010000:00010000:2.0:1788745025.327292:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 17 pid: 22750 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745025.327358:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:2.0:1788745025.327371:0:22735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+17:2392:x1875634396766464:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788745025.327406:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788745025.327413:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 17 pid: 22750 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.327426:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 17 pid: 22750 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.327453:0:22735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:2.0:1788745025.327459:0:22735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c96 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.327470:0:22735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.327479:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.327489:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.327519:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788745025.327694:0:22735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+17:2392:x1875634396766464:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 324us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.327703:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 21 00010000:00010000:1.0:1788745025.329180:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e400/0x6e465a23bbc2a3a7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421c88 expref: 16 pid: 22750 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745025.329207:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25091:1875634419942400:192.168.201.46@tcp:104: 00010000:00010000:1.0:1788745025.329242:0:25091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.329351:0:25091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.329358:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.329585:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.329602:0:25091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 16 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.329610:0:25091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.329659:0:25091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 16 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.329674:0:25091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 16 pid: 22751 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745025.329688:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25091:1875634419942528:192.168.201.46@tcp:104: 00000100:00100000:1.0:1788745025.329905:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce392419a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788745025.337534:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.337715:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396766592 00000100:00100000:2.0:1788745025.337727:0:22736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396766592 00010000:00010000:2.0:1788745025.337798:0:22736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 17 pid: 22751 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745025.337874:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 22 00000100:00100000:2.0:1788745025.337885:0:22736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+17:2393:x1875634396766592:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788745025.337908:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788745025.337917:0:22736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 17 pid: 22751 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.338234:0:22736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 17 pid: 22751 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.338288:0:22736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:2.0:1788745025.338295:0:22736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.338306:0:22736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.338315:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.338340:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788745025.338507:0:22736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+17:2393:x1875634396766592:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 623us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.338515:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 22 00010000:00010000:1.0:1788745025.339137:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920e00/0x6e465a23bbc2a42c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xfa57341394421cb2 expref: 16 pid: 22751 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745025.339158:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25091:1875634419942528:192.168.201.46@tcp:104: 00010000:00010000:1.0:1788745025.339188:0:25091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.339198:0:25091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.339203:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788745025.339353:0:25091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1788745025.339476:0:25091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788745025.339515:0:25091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1788745025.339749:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25091:1875634419942656:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788745025.339834:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745025.339960:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3a6df9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788745025.342557:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419942656 00000100:00100000:0.0:1788745025.342646:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419942656 00000100:00100000:0.0:1788745025.342915:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788745025.342940:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:25091:x1875634419942656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788745025.343123:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:25091:x1875634419942656:12345-0@lo:1000:mdt00_003.0 Request processed in 196us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745025.343130:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788745025.343216:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25091:1875634419942656:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788745025.343526:0:25091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788745025.343636:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25091:1875634419942784:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788745025.343692:0:25091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745025.344204:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3924196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788745025.344390:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419942784 00000100:00100000:3.0:1788745025.344400:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419942784 00000100:00100000:3.0:1788745025.344453:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788745025.344465:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:25091:x1875634419942784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788745025.345048:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:25091:x1875634419942784:12345-0@lo:1000:mdt00_003.0 Request processed in 585us (1355us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788745025.345058:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788745025.345530:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25091:1875634419942784:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788745025.345600:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345630:0:25091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345639:0:25091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345646:0:25091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3b403f600 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:1.0:1788745025.345652:0:25091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345661:0:25091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345680:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:1.0:1788745025.345683:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788745025.345688:0:25091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345694:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403f600/0x6e465a23bbc2a464 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345733:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345739:0:25091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345746:0:25091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345751:0:25091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920400 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:1.0:1788745025.345775:0:25091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345783:0:25091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345792:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:1.0:1788745025.345795:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788745025.345802:0:25091:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c96 expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345816:0:25091:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c96 expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345827:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c96 expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788745025.345892:0:25091:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804f400/0x6e465a23bbc2a3c3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421c96 expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788745025.345906:0:25091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25091:1875634419942912:192.168.201.46@tcp:105: 00000100:00100000:1.0:1788745025.346461:0:25091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ce3924196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788745025.352695:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745025.352825:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396766720 00000100:00100000:3.0:1788745025.352835:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396766720 00000100:00100000:3.0:1788745025.352891:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10 00000100:00100000:3.0:1788745025.352900:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac4bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+20:18769:x1875634396766720:12345-192.168.201.46@tcp:49:dd.0 00000100:00100000:3.0:1788745025.353048:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac4bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+20:18769:x1875634396766720:12345-192.168.201.46@tcp:49:dd.0 Request processed in 148us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745025.353056:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10 00000100:00100000:2.0:1788745025.355733:0:25091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25091:1875634419942912:192.168.201.46@tcp:105: 00010000:00010000:2.0:1788745025.355784:0:25091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355815:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287920400/0x6e465a23bbc2a3bc lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355848:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355862:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355874:0:25091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355885:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355892:0:25091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355899:0:25091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355904:0:25091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921600 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745025.355908:0:25091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355914:0:25091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355942:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:2.0:1788745025.355944:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788745025.355948:0:25091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355964:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce287921600/0x6e465a23bbc2a46b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355974:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355990:0:25091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.355996:0:25091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.356001:0:25091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce3b403e200 already unused, calling callback (ffffffffc17c14f0) 00010000:00010000:2.0:1788745025.356005:0:25091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.356011:0:25091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.356020:0:25091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:2.0:1788745025.356022:0:25091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788745025.356025:0:25091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.356030:0:25091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3b403e200/0x6e465a23bbc2a45d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745025.356206:0:25091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3be9d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d68d9106-f31a-4f98-bd1c-504f18088b76+19:18770:x1875634396766336:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 36073us (39008us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788745025.356217:0:25091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 63 00000020:00080000:2.0:1788745025.356229:0:25091:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788745025.357047:0:22786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788745025.357053:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788745025.357071:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788745025.357079:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788745025.363158:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745025.363336:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396766848 00000100:00100000:3.0:1788745025.363348:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396766848 00000100:00100000:3.0:1788745025.363412:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:3.0:1788745025.363560:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+19:18769:x1875634396766848:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:3.0:1788745025.363594:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788745025.363617:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a472 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa57341394421cce expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.363653:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f200/0x6e465a23bbc2a479 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.363671:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f200/0x6e465a23bbc2a479 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.363683:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f200/0x6e465a23bbc2a479 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.363820:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33fc00/0x6e465a23bbc2a472 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cce expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.363840:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce3bd33f200/0x6e465a23bbc2a479 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xfa57341394421cce expref: 20 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788745025.363849:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ce3895e9f00) 00010000:00010000:3.0:1788745025.363851:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788745025.363856:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ce3bd33f200, rc 0) 00000100:00100000:3.0:1788745025.363942:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+20:18769:x1875634396766848:12345-192.168.201.46@tcp:101:dd.0 Request processed in 385us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745025.365624:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:0.0:1788745025.368189:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745025.368456:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396767104 00000100:00100000:3.0:1788745025.368467:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396767104 00000100:00100000:0.0:1788745025.368809:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 11 00000100:00100000:0.0:1788745025.368821:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+20:18770:x1875634396767104:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788745025.369358:0:22754:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788745025.369391:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1788745025.369421:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.369455:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.369468:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.369477:0:22754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.369483:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.369489:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.369513:0:22754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788745025.369621:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+22:18770:x1875634396767104:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 801us (1438us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788745025.369630:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 11 00000020:00080000:0.0:1788745025.369635:0:22754:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788745025.369729:0:24937:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788745025.369736:0:24937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.369744:0:24937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce28804e800 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745025.369747:0:24937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.369754:0:24937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.369781:0:24937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ce3a1cb7500) 00010000:00010000:2.0:1788745025.369785:0:24937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788745025.369791:0:24937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.369797:0:24937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ce28804e800/0x6e465a23bbc2a480 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.369808:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745025.369810:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788745025.369811:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745025.390235:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745025.390319:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745025.390407:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396767360 00000100:00100000:2.0:1788745025.390416:0:24265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396767360 00000100:00100000:2.0:1788745025.390470:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396767232 00000100:00100000:2.0:1788745025.390472:0:24265:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396767232 00000100:00100000:2.0:1788745025.390485:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 0 00000100:00100000:2.0:1788745025.390491:0:24265:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+8:2393:x1875634396767360:12345-192.168.201.46@tcp:4:dd.0 00002000:00010000:2.0:1788745025.390531:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9e1540, atime: 0x6a9e153f, ctime: 0x6a9e1540, blocks: 0x0 00010000:00010000:2.0:1788745025.390539:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.390573:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1788745025.390577:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788745025.390583:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.390599:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788745025.480880:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1788745025.480910:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1788745025.481828:0:24265:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788745025.481835:0:24265:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788745024 -> 1788745025 00002000:00010000:2.0:1788745025.481838:0:24265:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788745024 -> 1788745025 00002000:00010000:2.0:1788745025.481841:0:24265:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1788745025.481859:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.481873:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.481883:0:24265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.481890:0:24265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287921600 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745025.481896:0:24265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.481904:0:24265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.481949:0:24265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.481957:0:24265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de899d25/0x6e465a23bbc2a487 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745025.482343:0:24265:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+6:2393:x1875634396767360:12345-192.168.201.46@tcp:4:dd.0 Request processed in 91843us (92111us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788745025.482353:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 0 00000100:00100000:2.0:1788745025.482388:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1 00000100:00100000:2.0:1788745025.482399:0:24265:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2878eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2393:x1875634396767232:12345-192.168.201.46@tcp:4:dd.0 00002000:00010000:2.0:1788745025.482447:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6a9e1541, atime: 0x6a9e153f, ctime: 0x6a9e1541, blocks: 0x1a68 00010000:00010000:2.0:1788745025.482454:0:24265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.482466:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1788745025.482470:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788745025.482477:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.482493:0:24265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788745025.553476:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788745025.563600:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788745025.563847:0:24265:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788745025.563875:0:24265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.563914:0:24265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.563925:0:24265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.563933:0:24265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ce287920a00 already unused, calling callback (ffffffffc0b888d0) 00010000:00010000:2.0:1788745025.563939:0:24265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.563951:0:24265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.563977:0:24265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788745025.563986:0:24265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084001f69/0x6e465a23bbc2a48e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788745025.564139:0:24265:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2878eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2393:x1875634396767232:12345-192.168.201.46@tcp:4:dd.0 Request processed in 81734us (173810us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788745025.564151:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1 00000100:00100000:3.0:1788745025.616471:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788745025.616495:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3b405f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419943040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788745025.616565:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745025.616597:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce3c1acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419943168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788745025.616634:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745025.616798:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419943040 00000100:00100000:0.0:1788745025.616808:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419943040 00000100:00100000:0.0:1788745025.616882:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419943168 00000100:00100000:0.0:1788745025.616886:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419943168 00000100:00100000:0.0:1788745025.616916:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788745025.616937:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419943040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788745025.616963:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419943296:0@lo:400:kworker.0 00002000:00000024:0.0:1788745025.616972:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788745025.617004:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745025.617054:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce286962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419943808:0@lo:400:kworker.0 00000100:00100000:1.0:1788745025.617078:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745025.617094:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce286960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419944320:0@lo:400:kworker.0 00000100:00100000:1.0:1788745025.617113:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745025.617132:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788745025.617137:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419943680:0@lo:400:kworker.0 00000100:00100000:1.0:1788745025.617157:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745025.617185:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce286961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1875634419944192:0@lo:400:kworker.0 00000100:00100000:1.0:1788745025.617202:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745025.617224:0:24738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419943808 00000100:00100000:1.0:1788745025.617228:0:24738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419943808 00000100:00100000:0.0:1788745025.617330:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419943040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 404us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.617349:0:24738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788745025.617362:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788745025.617364:0:24738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce286962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419943808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.617387:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788745025.617397:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bcb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419943168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788745025.617411:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788745025.617412:0:24738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce286962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419943808:12345-0@lo:400:kworker.0 Request processed in 52us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.617421:0:24738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788745025.617445:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419943680 00000100:00100000:0.0:1788745025.617450:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bcb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875634419943168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.617452:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419943680 00000100:00100000:0.0:1788745025.617460:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788745025.617484:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788745025.617487:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788745025.617490:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788745025.617498:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce286963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419943680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.617525:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419943552:0@lo:400:kworker.0 00000100:00100000:1.0:1788745025.617534:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce286963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419943680:12345-0@lo:400:kworker.0 Request processed in 39us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745025.617542:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788745025.617560:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745025.617579:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce286960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419944064:0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.617600:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788745025.617618:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788745025.617623:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2878e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419943424:0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.617647:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745025.617668:0:23766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419943424 00000100:00100000:0.0:1788745025.617669:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce286961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875634419943936:0@lo:400:kworker.0 00000100:00100000:2.0:1788745025.617681:0:23766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419943424 00000100:00100000:0.0:1788745025.617715:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745025.617720:0:23766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788745025.617730:0:23766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419943424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.617732:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce286960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1875634419944448:0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.617776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788745025.617791:0:23766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875634419943424:12345-0@lo:400:kworker.0 Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.617800:0:23766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788745025.617815:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1875634419943424:0@lo:400:kworker.0 00000100:00100000:2.0:1788745025.617831:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419944320 00000100:00100000:2.0:1788745025.617837:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419944320 00000100:00080000:2.0:1788745025.617859:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788745025.617863:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3c1acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1875634419943168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788745025.617882:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419944192 00000100:00100000:2.0:1788745025.617887:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419944192 00000100:00100000:0.0:1788745025.617900:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce3b405f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419943040:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788745025.617903:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788745025.617923:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419943552 00000100:00100000:2.0:1788745025.617928:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419943552 00000100:00100000:2.0:1788745025.617946:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419944064 00000100:00100000:0.0:1788745025.617948:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419943936 00000100:00100000:2.0:1788745025.617950:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419944064 00000100:00100000:0.0:1788745025.617955:0:22751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419943936 00000100:00080000:2.0:1788745025.617969:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788745025.617991:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419944448 00000100:00100000:2.0:1788745025.617995:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419944448 00000100:00080000:2.0:1788745025.618006:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788745025.618020:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788745025.618025:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce286961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875634419944320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788745025.618058:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce286961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875634419944320:12345-0@lo:400:kworker.0 Request processed in 32us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.618063:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788745025.618075:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788745025.618080:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce286963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875634419944192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788745025.618109:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce286963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875634419944192:12345-0@lo:400:kworker.0 Request processed in 29us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.618128:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788745025.618145:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788745025.618152:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419943552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788745025.618159:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419943296 00000100:00100000:3.0:1788745025.618166:0:22745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419943296 00000100:00100000:2.0:1788745025.618204:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875634419943552:12345-0@lo:400:kworker.0 Request processed in 53us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745025.618210:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788745025.618216:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788745025.618224:0:22745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3637:x1875634419943296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788745025.618241:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788745025.618283:0:22745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67ac6e5d-33bb-4bd9-870a-bea61ee993d9+24:3637:x1875634419943296:12345-0@lo:400:kworker.0 Request processed in 62us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745025.618290:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788745025.618424:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419943680:0@lo:400:kworker.0 00010000:00080000:1.0:1788745025.618439:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce286961500 x1875634419944192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788745025.618464:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce286961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1875634419944192:0@lo:400:kworker.0 00000100:00100000:1.0:1788745025.618474:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:67ac6e5d-33bb-4bd9-870a-bea61ee993d9:3637:1875634419943296:0@lo:400:kworker.0 00000100:00100000:1.0:1788745025.618486:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce286962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419943808:0@lo:400:kworker.0 00000100:00100000:1.0:1788745025.618494:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce286960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1875634419944320:0@lo:400:kworker.0 00000100:00100000:2.0:1788745025.618646:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875634419943936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.618665:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788745025.618684:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875634419943936:12345-0@lo:400:kworker.0 Request processed in 122us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.618692:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788745025.618707:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788745025.618714:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875634419944448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788745025.618741:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875634419944448:12345-0@lo:400:kworker.0 Request processed in 28us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745025.618746:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788745025.622055:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce286961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875634419943936:0@lo:400:kworker.0 00010000:00080000:0.0:1788745025.622080:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ce286960700 x1875634419944448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788745041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788745025.622092:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce286960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1875634419944448:0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.622105:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2878e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875634419943552:0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.622165:0:22751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419944064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788745025.622280:0:22751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875634419944064:12345-0@lo:400:kworker.0 Request processed in 3607us (4679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788745025.622290:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788745025.623107:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce286960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1875634419944064:0@lo:400:kworker.0 00010000:00010000:0.0:1788745026.576696:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788745027.549199:0:25836:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788745027.600595:0:24937:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788745027.665574:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788745027.665598:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce286960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419944576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788745027.665665:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745027.665715:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419944576 00000100:00100000:1.0:1788745027.665722:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419944576 00000100:00100000:1.0:1788745027.665800:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788745027.665815:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce286962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419944576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788745027.665843:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3908194304 avail 3676672000 00000100:00100000:1.0:1788745027.666056:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce286962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1875634419944576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745027.666064:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788745027.666087:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788745027.670440:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1788745027.670543:0:3634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ce3bcb56d80, transno 12884901892 00000004:00080000:2.0:1788745027.670562:0:3634:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1788745027.670601:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce286960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1875634419944576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788745028.626050:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788745028.677828:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745028.677897:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745028.677987:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1788745028.677987:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396767616 00000100:00100000:2.0:1788745028.678003:0:22750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396767616 00000100:00100000:3.0:1788745028.678018:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745028.678039:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745028.678743:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745028.678771:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1788745028.678791:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396767872 00000100:00100000:1.0:1788745028.678799:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396767872 00000100:00100000:3.0:1788745028.678988:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745028.679031:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1788745028.679059:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396768000 00000100:00100000:3.0:1788745028.679064:0:24258:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396768000 00000100:00100000:1.0:1788745028.679295:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396768512 00000100:00100000:1.0:1788745028.679300:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396768512 00000100:00100000:1.0:1788745028.679335:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396768384 00000100:00100000:1.0:1788745028.679337:0:24260:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396768384 00000100:00100000:1.0:1788745028.679360:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 24 00000100:00100000:1.0:1788745028.679376:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce288292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2395:x1875634396767872:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1788745028.679490:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce288292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2395:x1875634396767872:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 118us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745028.679516:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 24 00000100:00100000:1.0:1788745028.679543:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 25 00000100:00100000:1.0:1788745028.679550:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2394:x1875634396768512:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1788745028.679581:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2394:x1875634396768512:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 32us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745028.679587:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 25 00000100:00100000:1.0:1788745028.679598:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 26 00000100:00100000:1.0:1788745028.679604:0:24260:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce2882b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2395:x1875634396768384:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1788745028.679623:0:24260:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce2882b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2395:x1875634396768384:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 20us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745028.679629:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 26 00000100:00100000:3.0:1788745028.679768:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 27 00000100:00100000:3.0:1788745028.679777:0:24258:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2394:x1875634396768000:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745028.679805:0:24258:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2394:x1875634396768000:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 31us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745028.679820:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 27 00000100:00100000:1.0:1788745028.679961:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396767744 00000100:00100000:1.0:1788745028.679967:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396767744 00000100:00100000:1.0:1788745028.680001:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396768256 00000100:00100000:1.0:1788745028.680004:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396768256 00000100:00100000:1.0:1788745028.680025:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396768128 00000100:00100000:1.0:1788745028.680027:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396768128 00000100:00100000:1.0:1788745028.680053:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 63 00000100:00100000:1.0:1788745028.680061:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3bd50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2394:x1875634396767744:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788745028.680088:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:2.0:1788745028.680118:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2394:x1875634396768256:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788745028.680209:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+5:2394:x1875634396768256:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 108us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745028.680218:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:2.0:1788745028.680238:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00100000:2.0:1788745028.680262:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3c1acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+22:2395:x1875634396767616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788745028.680293:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3c1acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d68d9106-f31a-4f98-bd1c-504f18088b76+22:2395:x1875634396767616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 48us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745028.680302:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00100000:2.0:1788745028.680319:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:2.0:1788745028.680326:0:22750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce287a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2395:x1875634396768128:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1788745028.680351:0:22750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce287a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c925a64-231d-4d66-9b5c-6862a11d831d+6:2395:x1875634396768128:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 25us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788745028.680358:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:3.0:1788745028.680369:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634396767488 00000100:00100000:3.0:1788745028.680377:0:22744:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634396767488 00000100:00100000:3.0:1788745028.680437:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 169 00000100:00100000:3.0:1788745028.680446:0:22744:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3ac128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+13:2394:x1875634396767488:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1788745028.680486:0:22744:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3ac128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89bd4431-e5bd-4a95-a183-977432e8cc17+13:2394:x1875634396767488:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 41us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788745028.680493:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 169 00000100:00100000:1.0:1788745028.680755:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3bd50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d68d9106-f31a-4f98-bd1c-504f18088b76+5:2394:x1875634396767744:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 694us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745028.680763:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 63 00000100:00080000:1.0:1788745028.680786:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788745028.680791:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788745028.680795:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788745028.680808:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788745028.689001:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419944704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788745028.689115:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745028.689233:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419944704 00000100:00100000:1.0:1788745028.689384:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419944704 00000100:00100000:1.0:1788745028.689464:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788745028.689479:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce3b405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419944704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788745028.689533:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788745028.693236:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce3b405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875634419944704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3744us (4105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745028.693276:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788745028.693358:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce2882b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419944832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788745028.693439:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745028.693593:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419944832 00000100:00100000:1.0:1788745028.693604:0:24262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419944832 00000100:00100000:1.0:1788745028.693691:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788745028.693702:0:24262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce286961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419944832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788745028.693745:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3908194304 avail 3676672000 00000100:00100000:1.0:1788745028.693800:0:24262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce286961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875634419944832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745028.693807:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788745028.693829:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ce286963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419944960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788745028.693862:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788745028.693921:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634419944960 00000100:00100000:1.0:1788745028.693925:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634419944960 00000100:00100000:1.0:1788745028.693952:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788745028.693960:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ce286963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419944960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788745028.694002:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788745028.694045:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ce286963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875634419944960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788745028.694069:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788745028.694090:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788745028.694137:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce286963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1875634419944960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788745028.694182:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1875634419944832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788745028.698008:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ce2882b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1875634419944704:0@lo:41:osp-pre-1-0.0 Debug log: 14226 lines, 14226 kept, 0 dropped, 0 bad.