00010000:00010000:3.0F:1788666737.571758:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1788666738.589004:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666738.589037:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525042944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788666738.589113:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666738.589173:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525042944 00000100:00100000:2.0:1788666738.589187:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525042944 00000100:00100000:2.0:1788666738.589250:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788666738.589259:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525042944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788666738.589287:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788666738.589331:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525042944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666738.589338:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788666738.589359:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788666738.589477:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666738.589516:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525042944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788666739.100045:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707b4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525043072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666739.100115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.100195:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788666739.100205:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707b4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525043200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666739.100237:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.100285:0:20153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525043200 00000100:00100000:3.0:1788666739.100292:0:20153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525043200 00000100:00100000:3.0:1788666739.100346:0:20153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788666739.100357:0:20153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525043200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788666739.100393:0:20153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788666739.100450:0:20153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525043200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.100458:0:20153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788666739.100586:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707bf9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525043456:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.100611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.100637:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525043968:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.100660:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.100676:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875552525044480:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.100698:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.100715:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788666739.100721:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707bf9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09eda017-c07c-40fa-9b24-23f5903ec822:3641:1875552525043328:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.100748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.100777:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525043840:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.100796:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.100812:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875552525044352:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.100866:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.100891:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525043456 00000100:00100000:3.0:1788666739.100895:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525043456 00000100:00100000:3.0:1788666739.100923:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788666739.100929:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525043456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.100965:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525043456:12345-0@lo:400:kworker.0 Request processed in 36us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.100972:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788666739.100988:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525043968 00000100:00100000:3.0:1788666739.100992:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525043968 00000100:00100000:3.0:1788666739.101021:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525043840 00000100:00100000:3.0:1788666739.101024:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525043840 00000100:00100000:3.0:1788666739.101040:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788666739.101046:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525043968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101073:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525043968:12345-0@lo:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.101079:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788666739.101089:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788666739.101094:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525043840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101118:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525043840:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.101123:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788666739.101138:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525044480 00000100:00100000:3.0:1788666739.101141:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525044480 00000100:00100000:3.0:1788666739.101163:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525044352 00000100:00100000:3.0:1788666739.101165:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525044352 00000100:00100000:3.0:1788666739.101183:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788666739.101189:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875552525044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101226:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875552525044480:12345-0@lo:400:kworker.0 Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.101232:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788666739.101243:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788666739.101249:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875552525044352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101275:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875552525044352:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.101281:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788666739.101316:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525043584:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101339:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.101358:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525044096:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.101400:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525044608:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.101472:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707b4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525043200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666739.101489:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788666739.101494:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525043712:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101516:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.101531:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525044224:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.101574:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525044736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788666739.101593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666739.101616:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525044096 00000100:00100000:3.0:1788666739.101619:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525044096 00000100:00100000:3.0:1788666739.101644:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525044608 00000100:00100000:3.0:1788666739.101647:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525044608 00000100:00100000:3.0:1788666739.101658:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525043712 00000100:00100000:3.0:1788666739.101660:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525043712 00000100:00100000:3.0:1788666739.101668:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525044224 00000100:00100000:3.0:1788666739.101670:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525044224 00000100:00100000:3.0:1788666739.101681:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788666739.101687:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525044096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101723:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525044096:12345-0@lo:400:kworker.0 Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.101729:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788666739.101740:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788666739.101747:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875552525044608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101771:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875552525044608:12345-0@lo:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.101776:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788666739.101786:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788666739.101792:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525043712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101817:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525043712:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.101823:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788666739.101856:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666739.101863:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525044224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.101891:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525044224:12345-0@lo:400:kworker.0 Request processed in 29us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.101896:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666739.101915:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525044736 00000100:00100000:3.0:1788666739.101924:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525044736 00000100:00100000:3.0:1788666739.101948:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788666739.101954:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525044736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788666739.101975:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788666739.102005:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525044736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.102011:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788666739.102043:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525043584 00000100:00100000:3.0:1788666739.102047:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525043584 00000100:00100000:3.0:1788666739.102070:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788666739.102077:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525043584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.102104:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525043584:12345-0@lo:400:kworker.0 Request processed in 28us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666739.102110:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788666739.102142:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525043840:0@lo:400:kworker.0 00010000:00080000:3.0:1788666739.102155:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f42736a00 x1875552525044352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666739.102166:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875552525044352:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.102176:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707bf9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525043456:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.102186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525043968:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.102195:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875552525044480:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.102226:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525043712:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.102235:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525044224:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.102257:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525044736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788666739.102267:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525043584:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.102276:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525044096:0@lo:400:kworker.0 00010000:00080000:3.0:1788666739.102284:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f42737800 x1875552525044608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666739.102293:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525044608:0@lo:400:kworker.0 00000100:00100000:0.0F:1788666739.104031:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525043328 00000100:00100000:0.0:1788666739.104055:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525043328 00000100:00100000:0.0:1788666739.104107:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788666739.104115:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09eda017-c07c-40fa-9b24-23f5903ec822+24:3641:x1875552525043328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666739.104180:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09eda017-c07c-40fa-9b24-23f5903ec822+24:3641:x1875552525043328:12345-0@lo:400:kworker.0 Request processed in 66us (3431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666739.104186:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788666739.104315:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525043072 00000100:00100000:2.0:1788666739.104321:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525043072 00000100:00100000:2.0:1788666739.104354:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666739.104362:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525043072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666739.104384:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788666739.104438:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525043072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666739.104445:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666739.104466:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525044864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788666739.104499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788666739.104532:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666739.104537:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788666739.104541:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788666739.104544:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666739.104566:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525044864 00000100:00100000:2.0:1788666739.104571:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525044864 00000100:00100000:2.0:1788666739.104593:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788666739.104600:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525044864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788666739.104612:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788666739.104646:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525044864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666739.104653:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788666739.104691:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525044864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788666739.106373:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707bf9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09eda017-c07c-40fa-9b24-23f5903ec822:3641:1875552525043328:0@lo:400:kworker.0 00000100:00100000:3.0:1788666739.106426:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788666739.106431:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff937072f55880, transno 8589934596 00000004:00080000:3.0:1788666739.106445:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788666739.106474:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707b4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525043072:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788666739.109556:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1788666739.109576:0:17179:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93704356e6c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1788666739.109583:0:17179:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff937074d3fc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93704356ee40 00010000:00010000:0.0:1788666739.109583:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564aa9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788666739.109590:0:17179:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff937074d3f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff936f42132c00 00010000:00010000:0.0:1788666739.109601:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564aa9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666739.109610:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564aa9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666739.109617:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040030c00 already unused, calling callback (ffffffffc1a734f0) 00000020:00080000:1.0F:1788666739.109618:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:0.0:1788666739.109622:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564aa9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666739.109633:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564aa9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666739.109652:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937042dd2000) 00010000:00010000:0.0:1788666739.109656:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666739.109661:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564aa9f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666739.109667:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564aa9f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788666739.109685:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788666739.616540:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666739.972497:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666739.972581:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505048832 00000100:00100000:2.0:1788666739.972590:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505048832 00000100:00100000:2.0:1788666739.972665:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 65 00000100:00100000:2.0:1788666739.972675:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:010e24bf-8001-476e-bc22-4a53b5f32dd2+13:15603:x1875552505048832:12345-192.168.206.34@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788666739.972778:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:010e24bf-8001-476e-bc22-4a53b5f32dd2+13:15603:x1875552505048832:12345-192.168.206.34@tcp:60:lhsmtool_posix.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666739.972786:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 65 00000100:00080000:0.0:1788666739.972872:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666739.990222:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666739.990312:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666739.990350:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666739.990404:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505049088 00000100:00100000:1.0:1788666739.990426:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505049088 00000100:00100000:1.0:1788666739.990495:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 167 00000100:00100000:1.0:1788666739.990506:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90971f9e-2d7a-412a-a55f-8102d61df623+13:2394:x1875552505049088:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666739.990573:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90971f9e-2d7a-412a-a55f-8102d61df623+13:2394:x1875552505049088:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 68us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666739.990581:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 167 00000100:00100000:3.0:1788666740.002471:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505048960 00000100:00100000:3.0:1788666740.002487:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505048960 00000100:00100000:2.0:1788666740.002637:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505049216 00000100:00100000:2.0:1788666740.002642:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505049216 00000100:00080000:0.0:1788666740.002810:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788666740.002905:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 58 00000100:00100000:2.0:1788666740.002916:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+6:2395:x1875552505049216:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:2.0:1788666740.003000:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+6:2395:x1875552505049216:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 86us (12656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666740.003020:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 58 00000100:00100000:0.0:1788666740.003123:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666740.003193:0:19089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505049344 00000100:00100000:1.0:1788666740.003198:0:19089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505049344 00000100:00100000:1.0:1788666740.003237:0:19089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 21 00000100:00100000:1.0:1788666740.003244:0:19089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2394:x1875552505049344:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:0.0:1788666740.003253:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666740.003272:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666740.003321:0:19089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2394:x1875552505049344:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666740.003328:0:19089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 21 00000100:00100000:1.0:1788666740.003339:0:19089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505049472 00000100:00100000:1.0:1788666740.003341:0:19089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505049472 00000100:00100000:1.0:1788666740.003369:0:19089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 22 00000100:00100000:1.0:1788666740.003376:0:19089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2395:x1875552505049472:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666740.003426:0:19089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2395:x1875552505049472:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666740.003433:0:19089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 22 00000100:00080000:1.0:1788666740.003454:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788666740.003457:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666740.010900:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666740.013535:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505049600 00000100:00100000:3.0:1788666740.013550:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505049600 00000100:00100000:3.0:1788666740.013631:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 59 00000100:00100000:3.0:1788666740.013641:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae200c5e-e8db-444e-9ab2-f52c8340c444+6:2394:x1875552505049600:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666740.013726:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae200c5e-e8db-444e-9ab2-f52c8340c444+6:2394:x1875552505049600:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 87us (10452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666740.013733:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 59 00000100:00100000:2.0:1788666740.013971:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 66 00000100:00100000:2.0:1788666740.013978:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:15603:x1875552505048960:12345-192.168.206.34@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788666740.014030:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:15603:x1875552505048960:12345-192.168.206.34@tcp:60:lhsmtool_posix.0 Request processed in 52us (23819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666740.014037:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 66 00000100:00080000:1.0:1788666740.015007:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666740.020738:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505049728 00000100:00100000:2.0:1788666740.020752:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505049728 00000100:00100000:2.0:1788666740.020848:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 60 00000100:00100000:2.0:1788666740.020859:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2395:x1875552505049728:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:2.0:1788666740.020938:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2395:x1875552505049728:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 81us (10047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666740.020945:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 60 00000100:00100000:2.0:1788666740.021005:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666740.021064:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666740.021154:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505049856 00000100:00100000:1.0:1788666740.021159:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505049856 00000100:00100000:1.0:1788666740.021197:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505049984 00000100:00100000:1.0:1788666740.021200:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505049984 00000100:00100000:1.0:1788666740.021224:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 23 00000100:00100000:1.0:1788666740.021231:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2394:x1875552505049856:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666740.021263:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2394:x1875552505049856:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 33us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666740.021269:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 23 00000100:00100000:1.0:1788666740.021281:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 24 00000100:00100000:1.0:1788666740.021287:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2395:x1875552505049984:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666740.021315:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2395:x1875552505049984:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 28us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666740.021321:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 24 00000100:00080000:1.0:1788666740.021339:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788666740.021342:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666740.021352:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788666740.025040:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666740.025086:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505050240 00000100:00100000:3.0:1788666740.025096:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505050240 00000100:00100000:3.0:1788666740.025206:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 12 00000100:00100000:3.0:1788666740.025215:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:010e24bf-8001-476e-bc22-4a53b5f32dd2+13:15603:x1875552505050240:12345-192.168.206.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788666740.025557:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:010e24bf-8001-476e-bc22-4a53b5f32dd2+14:15603:x1875552505050240:12345-192.168.206.34@tcp:35:lhsmtool_posix.0 Request processed in 343us (524us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788666740.025566:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 12 00000040:00080000:2.0:1788666740.188608:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788666740.636069:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666741.660075:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666741.660309:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525044992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666741.660421:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666741.660985:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525044992 00000100:00100000:0.0:1788666741.660996:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525044992 00000100:00100000:0.0:1788666741.661069:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666741.661079:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525044992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666741.661110:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788666741.661194:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525044992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666741.661212:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788666741.661375:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666741.664422:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525044992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788666742.684705:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788666743.690600:0:20573:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:52:23 (1788666743) 00000100:00100000:2.0:1788666743.707955:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666743.707975:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525045120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788666743.708032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666743.708087:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525045120 00000100:00100000:2.0:1788666743.708094:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525045120 00000100:00080000:0.0:1788666743.708123:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666743.708145:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788666743.708153:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525045120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788666743.708319:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788666743.708364:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525045120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 211us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666743.713151:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525045120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788666743.713751:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788666743.713952:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666744.220305:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707bf9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09eda017-c07c-40fa-9b24-23f5903ec822:3640:1875552525045376:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.220398:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666744.220451:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525045888:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.220478:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666744.220511:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525046400:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.220665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666744.220686:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875552525046912:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.220709:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666744.220812:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788666744.220874:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525045504:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.220924:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666744.220944:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525046016:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.220965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666744.220987:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875552525046528:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.221008:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666744.221061:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525045376 00000100:00100000:3.0:1788666744.221068:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525045376 00000100:00100000:0.0:1788666744.221279:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666744.221287:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525047040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666744.221313:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666744.221348:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525045504 00000100:00100000:0.0:1788666744.221352:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525045504 00000100:00100000:0.0:1788666744.221408:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525046016 00000100:00100000:0.0:1788666744.221411:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525046016 00000100:00100000:0.0:1788666744.221424:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525047040 00000100:00100000:0.0:1788666744.221426:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525047040 00000100:00100000:0.0:1788666744.221437:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788666744.221444:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525045504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666744.221493:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525045504:12345-0@lo:400:kworker.0 Request processed in 49us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666744.221506:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788666744.221524:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788666744.221530:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875552525046016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666744.221678:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875552525046016:12345-0@lo:400:kworker.0 Request processed in 149us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666744.221685:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788666744.221699:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788666744.221705:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525047040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788666744.221739:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788666744.221769:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525047040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666744.221776:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788666744.221813:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525047040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666744.221825:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525045504:0@lo:400:kworker.0 00000100:00100000:0.0:1788666744.221850:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525046016:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.222674:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707bf9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525045248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666744.222747:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.222774:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525045760:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.222819:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.222866:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525046272:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.222888:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.222906:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875552525046784:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.222930:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.222940:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525047296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788666744.222959:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.222980:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788666744.222986:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525045632:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.223021:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.223039:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525046144:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.223058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.223604:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875552525046656:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.223637:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.223652:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525047168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788666744.223672:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666744.223705:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525045888 00000100:00100000:1.0:1788666744.223712:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525045888 00000100:00100000:3.0:1788666744.223794:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788666744.223804:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09eda017-c07c-40fa-9b24-23f5903ec822+24:3640:x1875552525045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.223871:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09eda017-c07c-40fa-9b24-23f5903ec822+24:3640:x1875552525045376:12345-0@lo:400:kworker.0 Request processed in 68us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666744.223878:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788666744.223910:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525046400 00000100:00100000:3.0:1788666744.223913:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525046400 00000100:00100000:3.0:1788666744.223952:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525046912 00000100:00100000:3.0:1788666744.223955:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525046912 00000100:00100000:3.0:1788666744.223979:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525046528 00000100:00100000:3.0:1788666744.223982:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525046528 00000100:00100000:3.0:1788666744.223993:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525046784 00000100:00100000:3.0:1788666744.223996:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525046784 00000100:00100000:3.0:1788666744.224007:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525046656 00000100:00100000:3.0:1788666744.224009:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525046656 00000100:00100000:3.0:1788666744.224022:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788666744.224028:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525046400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.224059:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525046400:12345-0@lo:400:kworker.0 Request processed in 31us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666744.224066:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788666744.224958:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525045248 00000100:00100000:2.0:1788666744.224966:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525045248 00000100:00100000:2.0:1788666744.225039:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525047168 00000100:00100000:2.0:1788666744.225042:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525047168 00000100:00100000:2.0:1788666744.225060:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788666744.225067:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525045248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666744.225268:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788666744.225280:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875552525046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.225333:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875552525046912:12345-0@lo:400:kworker.0 Request processed in 57us (4623us total) trans 0 rc 0/0 00002000:00000024:2.0:1788666744.225372:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788666744.225424:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525045248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 358us (2677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666744.225431:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788666744.225445:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788666744.225450:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525047168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788666744.225458:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788666744.225478:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525047168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 28us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666744.225483:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788666744.225958:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525047168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788666744.225979:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707bf9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525045248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666744.226746:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788666744.226761:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875552525046528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.226822:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875552525046528:12345-0@lo:400:kworker.0 Request processed in 67us (5812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.226829:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788666744.226862:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788666744.226880:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875552525046784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.226925:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875552525046784:12345-0@lo:400:kworker.0 Request processed in 57us (3994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.226946:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788666744.226963:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788666744.226972:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875552525046656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227010:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875552525046656:12345-0@lo:400:kworker.0 Request processed in 41us (3372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.227016:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788666744.227030:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788666744.227051:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227084:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525045888:12345-0@lo:400:kworker.0 Request processed in 48us (6606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.227091:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788666744.227119:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525045760 00000100:00100000:1.0:1788666744.227124:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525045760 00000100:00100000:1.0:1788666744.227362:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525046272 00000100:00100000:1.0:1788666744.227368:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525046272 00000100:00100000:1.0:1788666744.227401:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525045632 00000100:00100000:1.0:1788666744.227404:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525045632 00000100:00100000:1.0:1788666744.227423:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525046144 00000100:00100000:1.0:1788666744.227426:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525046144 00000100:00100000:1.0:1788666744.227444:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788666744.227451:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227489:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525045760:12345-0@lo:400:kworker.0 Request processed in 39us (4669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.227494:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788666744.227504:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666744.227509:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525046272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227552:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525046272:12345-0@lo:400:kworker.0 Request processed in 42us (4663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.227558:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666744.227570:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788666744.227577:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f444a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525045632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227607:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f444a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525045632:12345-0@lo:400:kworker.0 Request processed in 31us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.227613:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788666744.227631:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788666744.227639:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f444a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525046144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227672:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f444a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525046144:12345-0@lo:400:kworker.0 Request processed in 36us (4613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.227678:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788666744.227713:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525047296 00000100:00100000:1.0:1788666744.227717:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525047296 00000100:00100000:1.0:1788666744.227738:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788666744.227745:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525047296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788666744.227768:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788666744.227799:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525047296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (4838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666744.227805:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788666744.227864:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525045632:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227879:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525046144:0@lo:400:kworker.0 00010000:00080000:1.0:1788666744.227894:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93707f5cc380 x1875552525046656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666744.227916:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875552525046656:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227928:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525045760:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227937:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525046272:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227945:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875552525046784:0@lo:400:kworker.0 00000100:00100000:1.0:1788666744.227958:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525047296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788666744.228476:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788666744.228516:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666744.228520:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666744.228539:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666744.228542:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788666744.229341:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875552525046528:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.229355:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707bf9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09eda017-c07c-40fa-9b24-23f5903ec822:3640:1875552525045376:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.229364:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525045888:0@lo:400:kworker.0 00000100:00100000:3.0:1788666744.229373:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525046400:0@lo:400:kworker.0 00010000:00080000:3.0:1788666744.229386:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93707f5cf800 x1875552525046912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666744.229407:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875552525046912:0@lo:400:kworker.0 00010000:00010000:3.0:1788666744.733119:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788666744.734969:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788666744.734983:0:17179:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1788666744.735018:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1788666744.735030:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:2.0:1788666745.105677:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666745.105719:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666745.105927:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666745.106002:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505050368 00000100:00100000:0.0:1788666745.106011:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505050368 00000100:00100000:3.0:1788666745.106025:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505050624 00000100:00100000:3.0:1788666745.106029:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505050624 00000100:00100000:0.0:1788666745.106059:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 169 00000100:00100000:3.0:1788666745.106062:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505050496 00000100:00100000:3.0:1788666745.106065:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505050496 00000100:00100000:0.0:1788666745.106067:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90971f9e-2d7a-412a-a55f-8102d61df623+13:2394:x1875552505050368:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666745.106097:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 67 00000100:00100000:3.0:1788666745.106103:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2394:x1875552505050624:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666745.106138:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2394:x1875552505050624:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 34us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666745.106138:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90971f9e-2d7a-412a-a55f-8102d61df623+13:2394:x1875552505050368:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 71us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666745.106145:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 67 00000100:00100000:0.0:1788666745.106156:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 169 00000100:00100000:3.0:1788666745.106160:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 68 00000100:00100000:3.0:1788666745.106166:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+13:2394:x1875552505050496:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666745.106192:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:010e24bf-8001-476e-bc22-4a53b5f32dd2+13:2394:x1875552505050496:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666745.106204:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 68 00000100:00080000:3.0:1788666745.106220:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666745.106223:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788666745.113157:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666745.113186:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666745.113206:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666745.113232:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666745.113298:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505051136 00000100:00100000:0.0:1788666745.113307:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505051136 00000100:00100000:0.0:1788666745.113361:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505051008 00000100:00100000:0.0:1788666745.113364:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505051008 00000100:00100000:0.0:1788666745.113398:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 69 00000100:00100000:0.0:1788666745.113408:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707bf9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2395:x1875552505051136:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:0.0:1788666745.113474:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707bf9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2395:x1875552505051136:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666745.113481:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 69 00000100:00100000:0.0:1788666745.113497:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 70 00000100:00100000:0.0:1788666745.113503:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707bf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+6:2395:x1875552505051008:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:0.0:1788666745.113525:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707bf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+6:2395:x1875552505051008:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 22us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666745.113530:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 70 00000100:00080000:0.0:1788666745.113548:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788666745.113552:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788666745.113969:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505050752 00000100:00100000:1.0:1788666745.113976:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505050752 00000100:00100000:1.0:1788666745.114029:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505050880 00000100:00100000:1.0:1788666745.114032:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505050880 00000100:00100000:1.0:1788666745.114055:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 29 00000100:00100000:1.0:1788666745.114063:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2395:x1875552505050880:12345-192.168.206.34@tcp:400:kworker.0 00000100:00080000:0.0:1788666745.114196:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666745.114199:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666745.114264:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2395:x1875552505050880:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 202us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666745.114271:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 29 00000100:00100000:1.0:1788666745.114285:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 31 00000100:00100000:1.0:1788666745.114291:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2393:x1875552505050752:12345-192.168.206.34@tcp:9:kworker.0 00000020:00000080:1.0:1788666745.114308:0:18706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a7ce 00000100:00080000:1.0:1788666745.114323:0:18706:0:(import.c:65:import_set_state_nolock()) ffff936f43369000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788666745.114362:0:18706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788666745.114502:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:010e24bf-8001-476e-bc22-4a53b5f32dd2+2:2393:x1875552505050752:12345-192.168.206.34@tcp:9:kworker.0 Request processed in 210us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666745.114525:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 31 00010000:00010000:1.0:1788666745.114550:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666745.118715:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666745.118765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666745.118923:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505051264 00000100:00100000:1.0:1788666745.118933:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505051264 00000100:00100000:2.0:1788666745.118958:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505051392 00000100:00100000:2.0:1788666745.118961:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505051392 00000100:00100000:1.0:1788666745.118984:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 32 00000100:00100000:1.0:1788666745.119140:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2393:x1875552505051264:12345-192.168.206.34@tcp:9:kworker.0 00000020:00000080:1.0:1788666745.119173:0:18706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a80d 00000100:00080000:1.0:1788666745.119182:0:18706:0:(import.c:65:import_set_state_nolock()) ffff936f43060000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788666745.119225:0:18706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788666745.119364:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae200c5e-e8db-444e-9ab2-f52c8340c444+2:2393:x1875552505051264:12345-192.168.206.34@tcp:9:kworker.0 Request processed in 371us (657us total) trans 0 rc 0/0 00000100:00080000:0.0:1788666745.119736:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666745.119761:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666745.120164:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 33 00000100:00100000:2.0:1788666745.120176:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2393:x1875552505051392:12345-192.168.206.34@tcp:9:kworker.0 00000020:00000080:2.0:1788666745.120199:0:18704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a814 00000100:00080000:2.0:1788666745.120212:0:18704:0:(import.c:65:import_set_state_nolock()) ffff936f43061800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788666745.120517:0:18704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788666745.120626:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae200c5e-e8db-444e-9ab2-f52c8340c444+2:2393:x1875552505051392:12345-192.168.206.34@tcp:9:kworker.0 Request processed in 453us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666745.120634:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 33 00010000:00010000:2.0:1788666745.120656:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666745.120744:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 32 00010000:00010000:1.0:1788666745.120763:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666745.756483:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666746.780071:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666746.782643:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525047424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666746.782718:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666746.782882:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525047424 00000100:00100000:1.0:1788666746.782889:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525047424 00000100:00100000:1.0:1788666746.782949:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788666746.782958:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525047424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666746.783000:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666746.783048:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525047424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666746.783055:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788666746.783101:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525047424:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788666746.783608:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666747.301541:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666747.301683:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505051648 00000100:00100000:3.0:1788666747.301692:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505051648 00000100:00100000:3.0:1788666747.301773:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 13 00000100:00100000:3.0:1788666747.301787:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:010e24bf-8001-476e-bc22-4a53b5f32dd2+13:16364:x1875552505051648:12345-192.168.206.34@tcp:35:umount.0 00000001:00080000:3.0:1788666747.302088:0:17203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00080000:0.0:1788666747.302283:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666747.302342:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:010e24bf-8001-476e-bc22-4a53b5f32dd2+15:16364:x1875552505051648:12345-192.168.206.34@tcp:35:umount.0 Request processed in 559us (808us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1788666747.302351:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 13 00000020:00080000:3.0:1788666747.302355:0:17203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788666747.315666:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666747.315721:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666747.315754:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666747.315866:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505051776 00000100:00100000:0.0:1788666747.315880:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505051776 00000100:00100000:1.0:1788666747.315940:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666747.316105:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505051904 00000100:00100000:2.0:1788666747.316114:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505051904 00000100:00100000:2.0:1788666747.316183:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 34 00000100:00100000:2.0:1788666747.316196:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2393:x1875552505051904:12345-192.168.206.34@tcp:9:umount.0 00000020:00000080:2.0:1788666747.316240:0:18704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a7d5 00000100:00080000:2.0:1788666747.316249:0:18704:0:(import.c:65:import_set_state_nolock()) ffff936f4213f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788666747.316303:0:18704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788666747.316479:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:010e24bf-8001-476e-bc22-4a53b5f32dd2+2:2393:x1875552505051904:12345-192.168.206.34@tcp:9:umount.0 Request processed in 285us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666747.316488:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 34 00010000:00010000:2.0:1788666747.316511:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788666747.316521:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788666747.322389:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505052160 00000100:00100000:0.0:1788666747.322404:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505052160 00000100:00100000:0.0:1788666747.322460:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505052032 00000100:00100000:0.0:1788666747.322462:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505052032 00000100:00100000:0.0:1788666747.322491:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 3 00000100:00100000:0.0:1788666747.322500:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90971f9e-2d7a-412a-a55f-8102d61df623+15:2396:x1875552505051776:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666747.322515:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666747.322533:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937040031a00/0x4267b949b564a7ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52c7c expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666747.322554:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666747.322564:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 4 00000100:00100000:1.0:1788666747.322587:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075125c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90971f9e-2d7a-412a-a55f-8102d61df623+14:2396:x1875552505052160:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666747.322609:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788666747.322623:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90971f9e-2d7a-412a-a55f-8102d61df623+14:2396:x1875552505051776:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 119us (6897us total) trans 0 rc 0/0 00010000:00010000:1.0:1788666747.322635:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375f200/0x4267b949b564a861 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52d63 expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666747.322635:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 3 00010000:00010000:1.0:1788666747.322659:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666747.322668:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 5 00000100:00100000:0.0:1788666747.322679:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90971f9e-2d7a-412a-a55f-8102d61df623+12:2396:x1875552505052032:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666747.322690:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666747.322705:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f43338e00/0x4267b949b564a7b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52cad expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666747.322712:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075125c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90971f9e-2d7a-412a-a55f-8102d61df623+12:2396:x1875552505052160:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 131us (6953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666747.322734:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 4 00010000:00010000:0.0:1788666747.322738:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666747.322772:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90971f9e-2d7a-412a-a55f-8102d61df623+10:2396:x1875552505052032:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 94us (6833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666747.324635:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 5 00000100:00100000:2.0:1788666747.328412:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666747.328488:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505053056 00000100:00100000:0.0:1788666747.328503:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505053056 00000100:00100000:0.0:1788666747.328617:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 67 00000100:00100000:0.0:1788666747.328628:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:010e24bf-8001-476e-bc22-4a53b5f32dd2+15:2393:x1875552505053056:12345-192.168.206.34@tcp:39:umount.0 00000020:00000080:0.0:1788666747.328662:0:17201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a7c0 00000020:00010000:0.0:1788666747.328681:0:17201:0:(genops.c:1921:obd_stale_export_put()) Put export ffff936f4213e000: total 0 00000100:00080000:0.0:1788666747.328686:0:17201:0:(import.c:65:import_set_state_nolock()) ffff936f4213c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788666747.328716:0:17201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:0.0:1788666747.328917:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:010e24bf-8001-476e-bc22-4a53b5f32dd2+14:2393:x1875552505053056:12345-192.168.206.34@tcp:39:umount.0 Request processed in 289us (517us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788666747.328926:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 67 00000020:00010000:1.0:1788666747.329005:0:17188:0:(genops.c:1907:obd_stale_export_get()) Get export ffff936f4213e000: total 0 00010000:00010000:1.0:1788666747.329069:0:17188:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff936f4213e000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788666747.329101:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93704384b900) 00010000:00010000:1.0:1788666747.329104:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666747.329111:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564a8e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52d7f expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666747.329180:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff937042dd2000) 00010000:00010000:1.0:1788666747.329184:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666747.329189:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f9e00/0x4267b949b564aa75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52dfd expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666747.329209:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff937042dd2600) 00010000:00010000:1.0:1788666747.329211:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666747.329215:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f43339a00/0x4267b949b564a88b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52d6a expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666747.329267:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff937042dd2d00) 00010000:00010000:1.0:1788666747.329270:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788666747.329274:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4451fc00/0x4267b949b564a96b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52da9 expref: 10 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666747.329290:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff937042dd2a00) 00010000:00010000:1.0:1788666747.329292:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666747.329296:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4451f800/0x4267b949b564aa1a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52de8 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666747.329313:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff937042dd2a00) 00010000:00010000:1.0:1788666747.329315:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788666747.329319:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031c00/0x4267b949b564a9e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52dd3 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666747.329329:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff937042dd2a00) 00010000:00010000:1.0:1788666747.329332:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666747.329336:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f8800/0x4267b949b564aad0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e20 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666747.329349:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff937042dd2400) 00010000:00010000:1.0:1788666747.329351:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666747.329354:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f43339600/0x4267b949b564a8a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52d71 expref: 6 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666747.329365:0:17188:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff936f4213e000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1788666747.329389:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666747.329396:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666747.329398:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666747.337170:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666747.337326:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505053184 00000100:00100000:0.0:1788666747.337338:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505053184 00000100:00100000:0.0:1788666747.337506:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 68 00000100:00100000:0.0:1788666747.337518:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:010e24bf-8001-476e-bc22-4a53b5f32dd2+5:2393:x1875552505053184:12345-192.168.206.34@tcp:39:umount.0 00000020:00000080:0.0:1788666747.337563:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a7c7 00000100:00080000:0.0:1788666747.337585:0:17199:0:(import.c:65:import_set_state_nolock()) ffff936f4336e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788666747.337625:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788666747.338562:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:010e24bf-8001-476e-bc22-4a53b5f32dd2+3:2393:x1875552505053184:12345-192.168.206.34@tcp:39:umount.0 Request processed in 1035us (1394us total) trans 8589934593 rc 0/0 00010000:00010000:1.0:1788666747.338575:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666747.338578:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 68 00000100:00080000:2.0:1788666747.344970:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788666747.420147:0:17235:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788666747.420159:0:17235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666747.420180:0:17235:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788666747.420201:0:17235:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788666747.804034:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666748.828347:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525047552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788666748.828451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666748.828610:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525047552 00000100:00100000:1.0:1788666748.828695:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525047552 00000100:00100000:1.0:1788666748.828786:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788666748.828797:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525047552:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788666748.829442:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788666748.829578:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666748.829662:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525047552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 865us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666748.829671:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788666748.829880:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666748.829959:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525047552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788666748.972687:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666748.972801:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505053440 00000100:00100000:1.0:1788666748.972813:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505053440 00000100:00100000:1.0:1788666748.972930:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 6 00000100:00100000:1.0:1788666748.972941:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90971f9e-2d7a-412a-a55f-8102d61df623+10:2396:x1875552505053440:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666748.972961:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666748.972985:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375f600/0x4267b949b564a7f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52d1d expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666748.973005:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666748.973062:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90971f9e-2d7a-412a-a55f-8102d61df623+9:2396:x1875552505053440:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 123us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666748.973070:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 6 00000100:00100000:2.0:1788666748.973482:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666748.973503:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666748.973561:0:20224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505053312 00000100:00100000:0.0:1788666748.973566:0:20224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505053312 00000100:00100000:0.0:1788666748.973597:0:20224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505053568 00000100:00100000:0.0:1788666748.973599:0:20224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505053568 00000100:00100000:0.0:1788666748.973613:0:20224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:0.0:1788666748.973619:0:20224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90971f9e-2d7a-412a-a55f-8102d61df623+10:2396:x1875552505053312:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666748.973629:0:20224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666748.973639:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375f800/0x4267b949b564a7ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52cec expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666748.973649:0:20224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666748.973672:0:20224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90971f9e-2d7a-412a-a55f-8102d61df623+9:2396:x1875552505053312:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666748.973678:0:20224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:0.0:1788666748.973691:0:20224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:0.0:1788666748.973696:0:20224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90971f9e-2d7a-412a-a55f-8102d61df623+8:2396:x1875552505053568:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666748.973703:0:20224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666748.973771:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f43338c00/0x4267b949b564a830 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52d5c expref: 8 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666748.973782:0:20224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666748.973799:0:20224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90971f9e-2d7a-412a-a55f-8102d61df623+7:2396:x1875552505053568:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 103us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666748.973805:0:20224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:0.0:1788666748.979406:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666748.979693:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505053824 00000100:00100000:3.0:1788666748.979717:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505053824 00000100:00100000:3.0:1788666748.979824:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 69 00000100:00100000:3.0:1788666748.979879:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae200c5e-e8db-444e-9ab2-f52c8340c444+6:2393:x1875552505053824:12345-192.168.206.34@tcp:39:umount.0 00000020:00000080:3.0:1788666748.979941:0:17200:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a7ff 00000020:00010000:3.0:1788666748.979951:0:17200:0:(genops.c:1921:obd_stale_export_put()) Put export ffff937052124800: total 0 00000100:00080000:3.0:1788666748.979957:0:17200:0:(import.c:65:import_set_state_nolock()) ffff937066860000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788666748.980007:0:17200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1788666748.980188:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2393:x1875552505053824:12345-192.168.206.34@tcp:39:umount.0 Request processed in 354us (796us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1788666748.980197:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 69 00000020:00010000:2.0:1788666748.980622:0:18353:0:(genops.c:1907:obd_stale_export_get()) Get export ffff937052124800: total 0 00010000:00010000:2.0:1788666748.980635:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666748.980703:0:18353:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff937052124800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788666748.980755:0:18353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93704384b900) 00010000:00010000:2.0:1788666748.980758:0:18353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666748.980768:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f43339400/0x4267b949b564a8f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52d86 expref: 4 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666748.980795:0:18353:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff937052124800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788666748.980812:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666748.980814:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666748.980816:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666748.981294:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666749.002248:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666749.002478:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505053952 00000100:00100000:0.0:1788666749.002492:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505053952 00000100:00100000:0.0:1788666749.002591:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 70 00000100:00100000:0.0:1788666749.002604:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae200c5e-e8db-444e-9ab2-f52c8340c444+5:2393:x1875552505053952:12345-192.168.206.34@tcp:39:umount.0 00000020:00000080:0.0:1788666749.002661:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a806 00000100:00080000:0.0:1788666749.002672:0:17199:0:(import.c:65:import_set_state_nolock()) ffff93707b51b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788666749.002970:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788666749.003145:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae200c5e-e8db-444e-9ab2-f52c8340c444+3:2393:x1875552505053952:12345-192.168.206.34@tcp:39:umount.0 Request processed in 543us (910us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788666749.003155:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 70 00000100:00080000:2.0:1788666749.003549:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788666749.003733:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666749.070779:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666749.072533:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505054208 00000100:00100000:1.0:1788666749.072553:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505054208 00000100:00100000:1.0:1788666749.072857:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 170 00000100:00100000:1.0:1788666749.072871:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90971f9e-2d7a-412a-a55f-8102d61df623+7:2393:x1875552505054208:12345-192.168.206.34@tcp:251:umount.0 00000020:00000080:1.0:1788666749.072952:0:17194:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a79d 00000020:00010000:1.0:1788666749.072961:0:17194:0:(genops.c:1921:obd_stale_export_put()) Put export ffff936f4336e000: total 0 00000100:00080000:1.0:1788666749.072967:0:17194:0:(import.c:65:import_set_state_nolock()) ffff936f4336d800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788666749.073072:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90971f9e-2d7a-412a-a55f-8102d61df623+3:2393:x1875552505054208:12345-192.168.206.34@tcp:251:umount.0 Request processed in 204us (2306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666749.073081:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 170 00000020:00010000:3.0:1788666749.073691:0:17188:0:(genops.c:1907:obd_stale_export_get()) Get export ffff936f4336e000: total 0 00010000:00010000:3.0:1788666749.073774:0:17188:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff936f4336e000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788666749.073827:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375e400/0x4267b949b564a7a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52c75 expref: 2 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666749.073867:0:17188:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff936f4336e000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788666749.073879:0:17188:0:(genops.c:885:class_export_put()) final put ffff936f4336e000/90971f9e-2d7a-412a-a55f-8102d61df623 00010000:00010000:3.0:1788666749.073902:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666749.073905:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666749.073907:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788666749.074111:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4336e000/90971f9e-2d7a-412a-a55f-8102d61df623 for MGS 00000020:00000080:2.0:1788666749.074161:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f4336d800 for MGS 00000100:00100000:3.0:1788666749.340771:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09eda017-c07c-40fa-9b24-23f5903ec822:3638:1875552525047680:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.340867:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.340921:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525048192:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.340950:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.340970:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525048704:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.340991:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341008:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4444dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525049216:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341030:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341052:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788666749.341058:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525047808:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341081:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341114:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525048320:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341134:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341150:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525048832:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341169:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341204:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525047936:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341248:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525048448:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341285:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4444c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875552525048960:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341305:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341316:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788666749.341322:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525048064:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341342:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341373:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525048576:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341410:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4444d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875552525049088:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341429:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.341452:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525047680 00000100:00100000:3.0:1788666749.341458:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525047680 00000100:00100000:3.0:1788666749.341504:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788666749.341513:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09eda017-c07c-40fa-9b24-23f5903ec822+24:3638:x1875552525047680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341563:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09eda017-c07c-40fa-9b24-23f5903ec822+24:3638:x1875552525047680:12345-0@lo:400:kworker.0 Request processed in 51us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.341571:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788666749.341605:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525048192 00000100:00100000:3.0:1788666749.341615:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525048192 00000100:00100000:3.0:1788666749.341636:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525048704 00000100:00100000:3.0:1788666749.341638:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525048704 00000100:00100000:3.0:1788666749.341647:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525049216 00000100:00100000:3.0:1788666749.341649:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525049216 00000100:00100000:3.0:1788666749.341667:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525048832 00000100:00100000:3.0:1788666749.341669:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525048832 00000100:00100000:3.0:1788666749.341679:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525048960 00000100:00100000:3.0:1788666749.341681:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525048960 00000100:00100000:3.0:1788666749.341691:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525049088 00000100:00100000:3.0:1788666749.341693:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525049088 00000100:00100000:3.0:1788666749.341704:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788666749.341709:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4444d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525048192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341738:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4444d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525048192:12345-0@lo:400:kworker.0 Request processed in 29us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.341743:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788666749.341754:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788666749.341759:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4444f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525048704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341783:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4444f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525048704:12345-0@lo:400:kworker.0 Request processed in 24us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.341789:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788666749.341798:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788666749.341804:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4444f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875552525049216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341829:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4444f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875552525049216:12345-0@lo:400:kworker.0 Request processed in 25us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.341857:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788666749.341869:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788666749.341876:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525048832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341912:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525048832:12345-0@lo:400:kworker.0 Request processed in 37us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.341918:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788666749.341929:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788666749.341935:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875552525048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.341965:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875552525048960:12345-0@lo:400:kworker.0 Request processed in 31us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.341971:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788666749.341981:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788666749.341987:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875552525049088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342013:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875552525049088:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.342019:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788666749.342044:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525047808 00000100:00100000:3.0:1788666749.342048:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525047808 00000100:00100000:3.0:1788666749.342070:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525048320 00000100:00100000:3.0:1788666749.342073:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525048320 00000100:00100000:3.0:1788666749.342084:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788666749.342089:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525047808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342119:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525047808:12345-0@lo:400:kworker.0 Request processed in 29us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.342125:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788666749.342136:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788666749.342142:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525048320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342169:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525048320:12345-0@lo:400:kworker.0 Request processed in 28us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.342183:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788666749.342206:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525047936 00000100:00100000:3.0:1788666749.342210:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525047936 00000100:00100000:3.0:1788666749.342228:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525048448 00000100:00100000:3.0:1788666749.342231:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525048448 00000100:00100000:3.0:1788666749.342242:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525048064 00000100:00100000:3.0:1788666749.342244:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525048064 00000100:00100000:3.0:1788666749.342253:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525048576 00000100:00100000:3.0:1788666749.342256:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525048576 00000100:00100000:3.0:1788666749.342268:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788666749.342273:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525047936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342303:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525047936:12345-0@lo:400:kworker.0 Request processed in 30us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.342308:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788666749.342319:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788666749.342325:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525048448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342350:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525048448:12345-0@lo:400:kworker.0 Request processed in 25us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.342355:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788666749.342380:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788666749.342387:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525048064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342414:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525048064:12345-0@lo:400:kworker.0 Request processed in 28us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.342419:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788666749.342429:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788666749.342435:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525048576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342467:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525048576:12345-0@lo:400:kworker.0 Request processed in 33us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.342473:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788666749.342498:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666749.342501:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666749.342503:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666749.342505:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788666749.342539:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525048064:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342550:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525048576:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342559:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4444d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875552525049088:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342568:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525047936:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342576:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525048448:0@lo:400:kworker.0 00010000:00080000:3.0:1788666749.342587:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f4444c000 x1875552525048960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666749.342598:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4444c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875552525048960:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342639:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525047808:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342648:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525048320:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342657:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525048832:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342666:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09eda017-c07c-40fa-9b24-23f5903ec822:3638:1875552525047680:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342674:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525048192:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342685:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525048704:0@lo:400:kworker.0 00010000:00080000:3.0:1788666749.342705:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f4444dc00 x1875552525049216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666749.342715:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4444dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525049216:0@lo:400:kworker.0 00000100:00100000:3.0:1788666749.342806:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525049344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666749.342862:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666749.342898:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525049344 00000100:00100000:3.0:1788666749.342902:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525049344 00000100:00100000:3.0:1788666749.342927:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788666749.342933:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525049344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788666749.342957:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788666749.342992:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525049344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666749.342999:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788666749.343005:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525049472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788666749.343033:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525049344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666749.343052:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525049600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666749.343096:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666749.343144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666749.343166:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525049472 00000100:00100000:0.0:1788666749.343169:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525049472 00000100:00100000:0.0:1788666749.343186:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525049600 00000100:00100000:0.0:1788666749.343188:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525049600 00000100:00100000:0.0:1788666749.343197:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788666749.343203:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93705dd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525049472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788666749.343221:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788666749.343249:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93705dd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525049472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666749.343255:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788666749.343266:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788666749.343271:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93705dd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525049600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666749.343279:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788666749.343313:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93705dd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525049600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666749.343325:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788666749.343350:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525049600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666749.343385:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525049472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788666749.346876:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666749.346905:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525049728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788666749.346972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666749.347136:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525049728 00000100:00100000:0.0:1788666749.347144:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525049728 00000100:00100000:0.0:1788666749.347195:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788666749.347203:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525049728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788666749.347798:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788666749.347889:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525049728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 685us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666749.347897:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788666749.347946:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525049728:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788666749.856526:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788666750.428608:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788666750.687897:0:20768:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:2.0:1788666750.703133:0:20768:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788666750.703207:0:20768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666750.703225:0:20768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666750.703232:0:20768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666750.703261:0:20768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666750.703286:0:20768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788666750.703292:0:20768:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788666750.703323:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666750.703329:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788666750.703340:0:20768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788666750.703482:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666750.703490:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.703499:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4451f200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666750.703503:0:17187:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.703513:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666750.703521:0:17187:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666750.703528:0:17187:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788666750.703530:0:17187:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788666750.703533:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788666750.703568:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.703575:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666750.703601:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.703621:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4451f200/0x4267b949b564a360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a367 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.703633:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666750.703635:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666750.703637:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666750.703658:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09eda017-c07c-40fa-9b24-23f5903ec822:3639:1875552525049856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666750.703736:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666750.703816:0:20224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525049856 00000100:00100000:1.0:1788666750.703823:0:20224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525049856 00000100:00100000:1.0:1788666750.703901:0:20224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788666750.703911:0:20224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09eda017-c07c-40fa-9b24-23f5903ec822+24:3639:x1875552525049856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666750.703926:0:20224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666750.703942:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f43339e00/0x4267b949b564a367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a360 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.703955:0:20224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666750.703989:0:20224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09eda017-c07c-40fa-9b24-23f5903ec822+23:3639:x1875552525049856:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666750.703997:0:20224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788666750.704038:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09eda017-c07c-40fa-9b24-23f5903ec822:3639:1875552525049856:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788666750.704407:0:20768:0:(import.c:65:import_set_state_nolock()) ffff937044127000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788666750.704569:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875552525049984:0@lo:39:umount.0 00000100:00100000:1.0:1788666750.704606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666750.704686:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525049984 00000100:00100000:2.0:1788666750.704691:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525049984 00000100:00100000:2.0:1788666750.704935:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788666750.704944:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875552525049984:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788666750.704974:0:17200:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a391 00000100:00080000:2.0:1788666750.704983:0:17200:0:(import.c:65:import_set_state_nolock()) ffff93707b4ba000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788666750.705057:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1875552525049984:12345-0@lo:39:umount.0 Request processed in 114us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666750.705065:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1788666750.705073:0:17200:0:(genops.c:885:class_export_put()) final put ffff93706604b800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788666750.705126:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788666750.705139:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93706604b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788666750.705191:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93707b4ba000 for lustre-MDT0000 00000100:00080000:1.0:1788666750.707509:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937044127000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788666750.707540:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875552525049984:0@lo:39:umount.0 00000100:00080000:0.0:1788666750.707698:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788666750.707703:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788666750.707708:0:20768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788666750.709143:0:20768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.709165:0:20768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.709174:0:20768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.709182:0:20768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.709262:0:20768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788666750.709271:0:20768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.709279:0:20768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.709285:0:20768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.709291:0:20768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709348:0:18353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666750.709366:0:18353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709374:0:18353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4451ec00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666750.709378:0:18353:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709387:0:18353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666750.709395:0:18353:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666750.709401:0:18353:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788666750.709404:0:18353:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788666750.709446:0:18353:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709453:0:18353:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666750.709496:0:18353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709505:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4451ec00/0x4267b949b564a2b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a2b8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709522:0:18353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666750.709526:0:18353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709532:0:18353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93704dd0de00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666750.709543:0:18353:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709551:0:18353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666750.709557:0:18353:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666750.709563:0:18353:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788666750.709565:0:18353:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788666750.709579:0:18353:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709586:0:18353:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666750.709592:0:18353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.709600:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666750.709602:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666750.709604:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666750.709670:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09eda017-c07c-40fa-9b24-23f5903ec822:3641:1875552525050240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666750.709759:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666750.709853:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666750.709860:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09eda017-c07c-40fa-9b24-23f5903ec822:3641:1875552525050112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666750.709884:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666750.709916:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525050240 00000100:00100000:3.0:1788666750.709930:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525050240 00000100:00100000:3.0:1788666750.709978:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525050112 00000100:00100000:3.0:1788666750.709980:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525050112 00000100:00100000:3.0:1788666750.710000:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788666750.710009:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09eda017-c07c-40fa-9b24-23f5903ec822+24:3641:x1875552525050240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666750.710024:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788666750.710138:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666750.710147:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075125050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09eda017-c07c-40fa-9b24-23f5903ec822+24:3641:x1875552525050112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666750.710155:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666750.710164:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f43338400/0x4267b949b564a2b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a2b1 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.710180:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666750.710215:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075125050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09eda017-c07c-40fa-9b24-23f5903ec822+23:3641:x1875552525050112:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666750.710231:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666750.710275:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09eda017-c07c-40fa-9b24-23f5903ec822:3641:1875552525050112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666750.710312:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a3600/0x4267b949b564a6c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a6bd expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666750.710325:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666750.710364:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09eda017-c07c-40fa-9b24-23f5903ec822+21:3641:x1875552525050240:12345-0@lo:103:ldlm_bl.0 Request processed in 347us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666750.710370:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666750.710455:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09eda017-c07c-40fa-9b24-23f5903ec822:3641:1875552525050240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666750.710784:0:20768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788666750.710792:0:20768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93704dd0de00/0x4267b949b564a6bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a6c4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666750.710804:0:20768:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788666750.710814:0:20768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.710822:0:20768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.710829:0:20768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.710855:0:20768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.711981:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666750.711993:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.712004:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a2000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666750.712008:0:17187:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.712019:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666750.712028:0:17187:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666750.712034:0:17187:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788666750.712037:0:17187:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788666750.717675:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.717698:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666750.717742:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666750.717759:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666750.717762:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666750.717784:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666750.717874:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788666750.717901:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09eda017-c07c-40fa-9b24-23f5903ec822:3639:1875552525050368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666750.717988:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666750.718068:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525050368 00000100:00100000:3.0:1788666750.718077:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525050368 00000100:00100000:3.0:1788666750.718139:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788666750.718150:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09eda017-c07c-40fa-9b24-23f5903ec822+21:3639:x1875552525050368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666750.718167:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666750.718185:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a2a00/0x4267b949b564a86f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a868 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666750.718203:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666750.718243:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09eda017-c07c-40fa-9b24-23f5903ec822+20:3639:x1875552525050368:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666750.718251:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788666750.718298:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09eda017-c07c-40fa-9b24-23f5903ec822:3639:1875552525050368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666750.720875:0:20768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788666750.720896:0:20768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a2000/0x4267b949b564a868 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a86f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666750.720921:0:20768:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788666750.720943:0:20768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.720952:0:20768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.720959:0:20768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666750.720966:0:20768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666750.725070:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666750.725090:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666750.725104:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4451f000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788666750.725109:0:17188:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666750.725120:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666750.725128:0:17188:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666750.725135:0:17188:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788666750.725138:0:17188:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1788666750.726656:0:20768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1788666750.726672:0:20768:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1788666750.726685:0:20768:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788666750.726687:0:20768:0:(mgc_request.c:545:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788666750.726759:0:20768:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788666750.726764:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788666750.726770:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666750.726776:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788666750.726786:0:20768:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff936f43065000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788666750.726794:0:20768:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff937065bbe800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788666750.726798:0:20768:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff937065bbe000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788666750.726821:0:20768:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93704aebd800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788666750.726829:0:20768:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff937052124800 ae200c5e-e8db-444e-9ab2-f52c8340c444 192.168.206.34@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788666750.726850:0:20768:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff936f4213e000 010e24bf-8001-476e-bc22-4a53b5f32dd2 192.168.206.34@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1788666750.726856:0:20768:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff936f433799c0) has exports, disconnecting them 00000020:00080000:0.0:1788666750.726861:0:20768:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff936f43065000), last request at 1788666749 00000020:00000080:0.0:1788666750.726869:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a68c 00000100:00080000:0.0:1788666750.726891:0:20768:0:(import.c:65:import_set_state_nolock()) ffff936f43062800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788666750.726975:0:20768:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff936f43065000): rc 0 00000020:00000080:0.0:1788666750.726978:0:20768:0:(genops.c:885:class_export_put()) final put ffff936f43065000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788666750.726988:0:20768:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff937065bbe800), last request at 1788666749 00000020:00000080:0.0:1788666750.726992:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a53c 00000100:00080000:0.0:1788666750.726999:0:20768:0:(import.c:65:import_set_state_nolock()) ffff937065bbd000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788666750.727006:0:20768:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937065bbe800): rc 0 00000020:00000080:0.0:1788666750.727008:0:20768:0:(genops.c:885:class_export_put()) final put ffff937065bbe800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788666750.727011:0:20768:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff937065bbe000), last request at 1788666687 00000020:00000080:0.0:1788666750.727014:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a47f 00000100:00080000:0.0:1788666750.727017:0:20768:0:(import.c:65:import_set_state_nolock()) ffff937065bb9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788666750.727023:0:20768:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937065bbe000): rc 0 00000020:00000080:0.0:1788666750.727025:0:20768:0:(genops.c:885:class_export_put()) final put ffff937065bbe000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788666750.727028:0:20768:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93704aebd800), last request at 1788666687 00000020:00000080:0.0:1788666750.727031:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a424 00000100:00080000:0.0:1788666750.727035:0:20768:0:(import.c:65:import_set_state_nolock()) ffff9370523c9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788666750.727042:0:20768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00080000:0.0:1788666750.727138:0:20768:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93704aebd800): rc 0 00000004:00000080:0.0:1788666750.727146:0:20768:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7e9485e3ae8 00000100:00080000:0.0:1788666750.727169:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788666750.727179:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788666750.728397:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788666750.728615:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43065000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788666750.728687:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff937065bbe800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788666750.728715:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff937065bbe000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788666750.728736:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f43062800 for lustre-MDT0000 00000020:00000080:3.0:1788666750.728740:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937065bbd000 for lustre-MDT0000 00000020:00000080:3.0:1788666750.728744:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937065bb9800 for lustre-MDT0000 00010000:00010000:3.0:1788666750.728753:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666750.728884:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666750.728897:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666750.728923:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666750.728932:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4451f000/0x4267b949b564a2a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a2aa expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666750.728964:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666750.728966:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666750.728968:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666750.729015:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666750.729038:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09eda017-c07c-40fa-9b24-23f5903ec822:3638:1875552525050496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666750.729114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788666750.729124:0:20768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788666750.729145:0:20768:0:(import.c:65:import_set_state_nolock()) ffff937074b3c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788666750.729310:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525050496 00000100:00100000:2.0:1788666750.729320:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525050496 00000100:00100000:2.0:1788666750.729390:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666750.729400:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09eda017-c07c-40fa-9b24-23f5903ec822+20:3638:x1875552525050496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666750.729415:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666750.729434:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f43338800/0x4267b949b564a2aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a2a3 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666750.729447:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666750.729490:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09eda017-c07c-40fa-9b24-23f5903ec822+19:3638:x1875552525050496:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666750.729497:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666750.729570:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09eda017-c07c-40fa-9b24-23f5903ec822:3638:1875552525050496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666750.729779:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525050624:0@lo:39:umount.0 00000100:00100000:2.0:1788666750.729813:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666750.729934:0:20153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525050624 00000100:00100000:3.0:1788666750.729938:0:20153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525050624 00000100:00100000:3.0:1788666750.729977:0:20153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788666750.729984:0:20153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875552525050624:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788666750.730011:0:20153:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a4a9 00000100:00080000:3.0:1788666750.730019:0:20153:0:(import.c:65:import_set_state_nolock()) ffff937047f7d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788666750.730057:0:20153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788666750.730188:0:20153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3637:x1875552525050624:12345-0@lo:39:umount.0 Request processed in 204us (374us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788666750.730195:0:20153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788666750.730223:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788666750.730229:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525050624:0@lo:39:umount.0 00010000:00010000:2.0:1788666750.730401:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666750.730483:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788666750.730489:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788666750.730506:0:20768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788666750.730571:0:20768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788666750.730589:0:20768:0:(import.c:65:import_set_state_nolock()) ffff93707f61e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788666750.730608:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788666750.730610:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788666750.730624:0:20768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788666750.730685:0:20768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788666750.730696:0:20768:0:(import.c:65:import_set_state_nolock()) ffff93707b94d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788666750.730742:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff936f433799c0) has no exports 00000100:00100000:3.0:1788666750.730981:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525050752:0@lo:9:umount.0 00000100:00100000:3.0:1788666750.731025:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666750.731060:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525050880:0@lo:9:umount.0 00000100:00100000:3.0:1788666750.731082:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666750.731142:0:19089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525050752 00000100:00100000:0.0:1788666750.731149:0:19089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525050752 00000100:00100000:1.0:1788666750.731155:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525050880 00000100:00100000:1.0:1788666750.731161:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525050880 00000100:00100000:0.0:1788666750.731578:0:19089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788666750.731589:0:19089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875552525050752:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788666750.731619:0:19089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a56d 00000100:00080000:0.0:1788666750.731630:0:19089:0:(import.c:65:import_set_state_nolock()) ffff937066865800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788666750.731690:0:19089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:2.0:1788666750.731824:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666750.731921:0:19089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1875552525050752:12345-0@lo:9:umount.0 Request processed in 332us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666750.731931:0:19089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788666750.731955:0:19089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788666750.731964:0:19089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875552525050880:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788666750.731979:0:19089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a6cb 00000100:00080000:0.0:1788666750.731986:0:19089:0:(import.c:65:import_set_state_nolock()) ffff93707f5b0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788666750.732027:0:19089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788666750.732137:0:19089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1875552525050880:12345-0@lo:9:umount.0 Request processed in 174us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666750.732145:0:19089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788666750.732218:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788666750.733916:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93707f61e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788666750.733948:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788666750.733950:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788666750.733956:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525050752:0@lo:9:umount.0 00000100:00080000:2.0:1788666750.733974:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93707b94d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788666750.733983:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788666750.733985:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788666750.733987:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525050880:0@lo:9:umount.0 00000001:00100000:1.0:1788666750.741187:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666750.741195:0:18701:0:(genops.c:885:class_export_put()) final put ffff937047f7a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788666750.741216:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae200c5e-e8db-444e-9ab2-f52c8340c444 00000020:00000080:1.0:1788666750.741218:0:18701:0:(genops.c:885:class_export_put()) final put ffff936f43063000/ae200c5e-e8db-444e-9ab2-f52c8340c444 00000001:00100000:1.0:1788666750.741225:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 010e24bf-8001-476e-bc22-4a53b5f32dd2 00000020:00000080:1.0:1788666750.741227:0:18701:0:(genops.c:885:class_export_put()) final put ffff936f4336a000/010e24bf-8001-476e-bc22-4a53b5f32dd2 00000020:00000080:1.0:1788666750.741241:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff937047f7a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788666750.741292:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43063000/ae200c5e-e8db-444e-9ab2-f52c8340c444 for lustre-OST0000 00000020:00000080:1.0:1788666750.741308:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4336a000/010e24bf-8001-476e-bc22-4a53b5f32dd2 for lustre-OST0000 00000020:00000080:1.0:1788666750.741324:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937066865800 for lustre-OST0000 00000020:00000080:1.0:1788666750.741329:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f43060000 for lustre-OST0000 00000020:00000080:1.0:1788666750.741332:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f43369000 for lustre-OST0000 00000001:00100000:1.0:1788666750.743211:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666750.743220:0:19518:0:(genops.c:885:class_export_put()) final put ffff93707f5b5000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788666750.743251:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 010e24bf-8001-476e-bc22-4a53b5f32dd2 00000020:00000080:1.0:1788666750.743254:0:19518:0:(genops.c:885:class_export_put()) final put ffff936f4213d000/010e24bf-8001-476e-bc22-4a53b5f32dd2 00000001:00100000:1.0:1788666750.743263:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae200c5e-e8db-444e-9ab2-f52c8340c444 00000020:00000080:1.0:1788666750.743265:0:19518:0:(genops.c:885:class_export_put()) final put ffff936f43064800/ae200c5e-e8db-444e-9ab2-f52c8340c444 00000020:00000080:2.0:1788666750.743348:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93707f5b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788666750.743418:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4213d000/010e24bf-8001-476e-bc22-4a53b5f32dd2 for lustre-OST0001 00000020:00000080:2.0:1788666750.743449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43064800/ae200c5e-e8db-444e-9ab2-f52c8340c444 for lustre-OST0001 00000020:00000080:2.0:1788666750.743463:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93707f5b0000 for lustre-OST0001 00000020:00000080:2.0:1788666750.743470:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f4213f800 for lustre-OST0001 00000020:00000080:2.0:1788666750.743474:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f43061800 for lustre-OST0001 00000020:00080000:2.0:1788666750.762040:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff936f433799c0) has no exports 00000020:00000080:2.0:1788666750.820793:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a2fe 00000020:00000080:2.0:1788666750.820811:0:20768:0:(genops.c:885:class_export_put()) final put ffff93707f61e800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788666750.820864:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788666750.820960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93707f61e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788666750.820991:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666750.821001:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788666750.821006:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93706f013380) has no exports 00000020:00000080:3.0:1788666750.821457:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a2f7 00000020:00000080:3.0:1788666750.821469:0:20768:0:(genops.c:885:class_export_put()) final put ffff93707b94a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788666750.821557:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666750.821569:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788666750.821572:0:20768:0:(genops.c:885:class_export_put()) final put ffff93707b949800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788666750.821576:0:20768:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b949800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788666750.821582:0:20768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788666750.821755:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b94a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788666750.876759:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666751.900978:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666752.924962:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788666752.925893:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788666752.925912:0:17179:0:(genops.c:885:class_export_put()) final put ffff93704aebd800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788666752.925939:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae200c5e-e8db-444e-9ab2-f52c8340c444 00000001:00080000:1.0:1788666752.925952:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1788666752.925956:0:17179:0:(genops.c:885:class_export_put()) final put ffff937052124800/ae200c5e-e8db-444e-9ab2-f52c8340c444 00000001:00100000:1.0:1788666752.925962:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 010e24bf-8001-476e-bc22-4a53b5f32dd2 00000001:00080000:1.0:1788666752.925967:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:1.0:1788666752.925972:0:17179:0:(genops.c:885:class_export_put()) final put ffff936f4213e000/010e24bf-8001-476e-bc22-4a53b5f32dd2 00000020:00000080:2.0:1788666752.926033:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93704aebd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788666752.926318:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff937052124800/ae200c5e-e8db-444e-9ab2-f52c8340c444 for lustre-MDT0000 00000020:00000080:2.0:1788666752.926376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4213e000/010e24bf-8001-476e-bc22-4a53b5f32dd2 for lustre-MDT0000 00000020:00000080:2.0:1788666752.926403:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9370523c9800 for lustre-MDT0000 00000020:00000080:2.0:1788666752.926409:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937066860000 for lustre-MDT0000 00000020:00000080:2.0:1788666752.926413:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f4213c000 for lustre-MDT0000 00000001:00100000:2.0:1788666752.931912:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788666752.931938:0:17932:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1788666752.931945:0:17932:0:(genops.c:885:class_export_put()) final put ffff937047f79000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788666752.931974:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ae200c5e-e8db-444e-9ab2-f52c8340c444 00000001:00080000:2.0:1788666752.931980:0:17932:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1788666752.931982:0:17932:0:(genops.c:885:class_export_put()) final put ffff937066866000/ae200c5e-e8db-444e-9ab2-f52c8340c444 00000001:00100000:2.0:1788666752.931988:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 010e24bf-8001-476e-bc22-4a53b5f32dd2 00000001:00080000:2.0:1788666752.931992:0:17932:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1788666752.932014:0:17932:0:(genops.c:885:class_export_put()) final put ffff936f4336c800/010e24bf-8001-476e-bc22-4a53b5f32dd2 00000020:00000080:1.0:1788666752.932566:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff937047f79000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788666752.932666:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff937066866000/ae200c5e-e8db-444e-9ab2-f52c8340c444 for lustre-MDT0001 00000020:00000080:1.0:1788666752.932693:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4336c800/010e24bf-8001-476e-bc22-4a53b5f32dd2 for lustre-MDT0001 00000020:00000080:1.0:1788666752.932720:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937047f7d800 for lustre-MDT0001 00000020:00000080:1.0:1788666752.932726:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93707b51b800 for lustre-MDT0001 00000020:00000080:1.0:1788666752.932730:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f4336e800 for lustre-MDT0001 00010000:00010000:2.0:1788666753.949082:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666753.949180:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525051008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788666753.949250:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666753.949539:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525051008 00000100:00100000:2.0:1788666753.949547:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525051008 00000100:00100000:2.0:1788666753.949615:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788666753.949625:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525051008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788666753.949655:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788666753.949716:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525051008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666753.949724:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788666753.949827:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666753.949948:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525051008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788666754.461096:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525051136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788666754.461820:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666754.462113:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09eda017-c07c-40fa-9b24-23f5903ec822:3638:1875552525051264:0@lo:400:kworker.0 00000100:00100000:0.0:1788666754.462304:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707b4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525051520:0@lo:400:kworker.0 00000100:00100000:0.0:1788666754.462354:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666754.462380:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875552525052032:0@lo:400:kworker.0 00000100:00100000:0.0:1788666754.462407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666754.462427:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788666754.462432:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525051648:0@lo:400:kworker.0 00000100:00100000:0.0:1788666754.462452:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666754.462469:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875552525052160:0@lo:400:kworker.0 00000100:00100000:0.0:1788666754.462489:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666754.462522:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525052032 00000100:00100000:0.0:1788666754.462530:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525052032 00000100:00100000:0.0:1788666754.462572:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525051648 00000100:00100000:0.0:1788666754.462576:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525051648 00000100:00100000:0.0:1788666754.462584:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525052160 00000100:00100000:0.0:1788666754.462586:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525052160 00000100:00100000:0.0:1788666754.462618:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788666754.462629:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875552525052160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666754.462688:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875552525052160:12345-0@lo:400:kworker.0 Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666754.462716:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788666754.462783:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788666754.462795:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875552525052032:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788666754.462804:0:17200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788666754.462908:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875552525052032:12345-0@lo:400:kworker.0 Request processed in 112us (498us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788666754.462915:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788666754.462995:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666754.463035:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525051776:0@lo:400:kworker.0 00000100:00100000:1.0:1788666754.463066:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666754.463084:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525052288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788666754.463112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666754.463132:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666754.463138:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707b4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525051392:0@lo:400:kworker.0 00000100:00100000:3.0:1788666754.463705:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525051776 00000100:00100000:3.0:1788666754.463905:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525051776 00000100:00100000:1.0:1788666754.464016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666754.464060:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525051904:0@lo:400:kworker.0 00000100:00100000:1.0:1788666754.464088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666754.464120:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525051520 00000100:00100000:1.0:1788666754.464125:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525051520 00000100:00100000:0.0:1788666754.464279:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525051904 00000100:00100000:0.0:1788666754.464284:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525051904 00000100:00100000:1.0:1788666754.464356:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788666754.464367:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525051520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666754.464429:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525051520:12345-0@lo:400:kworker.0 Request processed in 64us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666754.464436:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788666754.464463:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788666754.464469:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875552525051648:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788666754.464476:0:17201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788666754.464507:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875552525051648:12345-0@lo:400:kworker.0 Request processed in 36us (2052us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788666754.464513:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788666754.467104:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788666754.467120:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1875552525051776:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788666754.467132:0:20337:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788666754.467355:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1875552525051776:12345-0@lo:400:kworker.0 Request processed in 129us (4181us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788666754.467392:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788666754.467784:0:20153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525052288 00000100:00100000:3.0:1788666754.467796:0:20153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525052288 00000100:00100000:3.0:1788666754.467859:0:20153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525051392 00000100:00100000:3.0:1788666754.467863:0:20153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525051392 00000100:00100000:3.0:1788666754.467876:0:20153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666754.467884:0:20153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1875552525052288:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788666754.467893:0:20153:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1788666754.467908:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788666754.467942:0:20153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1875552525052288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (4828us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788666754.467950:0:20153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666754.467963:0:20153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788666754.467967:0:20153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1875552525051392:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788666754.467971:0:20153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788666754.467995:0:20153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1875552525051392:12345-0@lo:400:kworker.0 Request processed in 26us (3981us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788666754.468001:0:20153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788666754.468087:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525051264 00000100:00100000:3.0:1788666754.468092:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525051264 00000100:00100000:3.0:1788666754.468131:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788666754.468139:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4301d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09eda017-c07c-40fa-9b24-23f5903ec822+19:3638:x1875552525051264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666754.468186:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4301d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09eda017-c07c-40fa-9b24-23f5903ec822+19:3638:x1875552525051264:12345-0@lo:400:kworker.0 Request processed in 48us (5193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666754.468192:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788666754.468276:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525051136 00000100:00100000:2.0:1788666754.468287:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525051136 00000100:00100000:2.0:1788666754.468380:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788666754.468391:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525051136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788666754.468422:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00080000:0.0:1788666754.468679:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788666754.468687:0:3640:0:(import.c:65:import_set_state_nolock()) ffff937065bba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788666754.468692:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788666754.469298:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666754.469330:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788666754.469356:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525051904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666754.469428:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525051904:12345-0@lo:400:kworker.0 Request processed in 79us (5338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666754.469436:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788666754.469695:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525051136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1305us (7876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666754.469703:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788666754.469751:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525051136:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788666754.475430:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788666754.475439:0:3638:0:(import.c:65:import_set_state_nolock()) ffff936f43edd000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788666754.475444:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788666754.475450:0:3638:0:(import.c:65:import_set_state_nolock()) ffff936f43edd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666754.475454:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:1.0:1788666754.475466:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff936f43edd000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666754.475513:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43763100 x1875552525052416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666754.475539:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707b4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525051392:0@lo:400:kworker.0 00010000:00080000:1.0:1788666754.475557:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f43e65c00 x1875552525051904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666754.475585:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525051904:0@lo:400:kworker.0 00000100:02020000:1.0:1788666754.475598:0:3638:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1788666754.475685:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525052416:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788666754.476468:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666754.478291:0:20153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525052416 00000100:00100000:3.0:1788666754.478310:0:20153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525052416 00000100:00100000:3.0:1788666754.478388:0:20153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788666754.478398:0:20153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875552525052416:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788666754.478423:0:20153:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788666754.478531:0:20153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875552525052416:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 133us (2065us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788666754.478538:0:20153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788666754.478668:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f43edd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666754.478675:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788666754.478679:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525052416:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788666754.487727:0:3640:0:(import.c:65:import_set_state_nolock()) ffff937065bba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666754.487738:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1788666754.487747:0:3640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff937065bba000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666754.488641:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f427f1c00 x1875552525052544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788666754.488682:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525051648:0@lo:400:kworker.0 00010000:00080000:0.0:1788666754.488717:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f43761f80 x1875552525052160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666754.488729:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875552525052160:0@lo:400:kworker.0 00000100:00100000:0.0:1788666754.488743:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707b4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525051520:0@lo:400:kworker.0 00000100:00080000:0.0:1788666754.488756:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788666754.488760:0:3640:0:(import.c:65:import_set_state_nolock()) ffff936f4336a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788666754.488764:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788666754.488768:0:3640:0:(import.c:65:import_set_state_nolock()) ffff936f4336a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666754.488772:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 536 00000100:00100000:3.0:1788666754.488783:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875552525052544:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788666754.488873:0:3640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff936f4336a800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:3.0:1788666754.488922:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666754.488965:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93707f600380 x1875552525052672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788666754.488987:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875552525052032:0@lo:400:kworker.0 00000100:00100000:3.0:1788666754.489002:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525052544 00000100:00100000:3.0:1788666754.489012:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525052544 00000100:00100000:3.0:1788666754.489076:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788666754.489085:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875552525052544:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788666754.489107:0:17200:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788666754.489253:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875552525052544:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 167us (331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788666754.489263:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788666754.489298:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875552525052672:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788666754.489325:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788666754.489371:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937065bba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666754.489376:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788666754.489381:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875552525052544:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788666754.497066:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525052672 00000100:00100000:2.0:1788666754.497078:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525052672 00000100:00100000:2.0:1788666754.497149:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788666754.497157:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875552525052672:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788666754.497175:0:17201:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788666754.497271:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875552525052672:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 113us (7943us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788666754.497278:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788666754.497702:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f4336a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666754.497715:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788666754.497720:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875552525052672:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788666754.507734:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788666754.507741:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff936f43edd000 already not connected (conn 2, was 1): DISCONN 00000100:00100000:1.0:1788666754.509072:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707bf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09eda017-c07c-40fa-9b24-23f5903ec822:3638:1875552525051264:0@lo:400:kworker.0 00000100:00080000:1.0:1788666754.509091:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788666754.509095:0:3638:0:(import.c:65:import_set_state_nolock()) ffff936f42366000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788666754.509099:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788666754.509104:0:3638:0:(import.c:65:import_set_state_nolock()) ffff936f42366000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666754.509108:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1788666754.509116:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff936f42366000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666754.509149:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43760380 x1875552525052800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788666754.509240:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875552525052800:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788666754.509300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666754.509523:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525052800 00000100:00100000:0.0:1788666754.509530:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525052800 00000100:00100000:0.0:1788666754.509567:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788666754.509574:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875552525052800:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788666754.509595:0:20337:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788666754.509755:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525051776:0@lo:400:kworker.0 00000100:00100000:0.0:1788666754.511072:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875552525052800:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 1490us (1764us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788666754.511085:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788666754.512599:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f42366000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666754.512609:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788666754.512614:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875552525052800:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1788666754.974092:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666755.996113:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788666756.891982:0:20768:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937046dc8960 - data ffff937065d995e8/ffff936f43eff800 00000020:01000000:3.0:1788666756.892364:0:20768:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937043ffa840 - data ffff937065d6a798/ffff9370769d0800 00000001:00000004:3.0:1788666756.902198:0:20768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:2.0:1788666756.941712:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788666756.941721:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788666756.941734:0:20768:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93705dd54380 x1875552525050624/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788666760 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666756.941761:0:20768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788666756.947485:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788666756.947492:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788666756.947569:0:20768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788666756.947572:0:20768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788666756.950349:0:17223:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788666756.950356:0:17223:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788666756.950367:0:17223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788666756.951393:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788666756.951399:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1788666756.951419:0:20768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788666756.951422:0:20768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788666756.951952:0:17225:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788666756.951956:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788666756.951966:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788666756.953092:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a2c6 00000020:00000080:2.0:1788666756.953103:0:20768:0:(genops.c:885:class_export_put()) final put ffff937066862800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788666756.954025:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff937066862800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788666756.954707:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a2db 00000020:00000080:2.0:1788666756.954716:0:20768:0:(genops.c:885:class_export_put()) final put ffff936f437a0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788666756.954772:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788666756.954778:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666756.954787:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788666756.954791:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff936f4337b380) has no exports 00000004:01000000:2.0:1788666756.954989:0:20768:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788666756.954997:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a33d 00000020:00000080:2.0:1788666756.955001:0:20768:0:(genops.c:885:class_export_put()) final put ffff936f437a1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666756.955633:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f437a0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788666756.955714:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788666756.955720:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666756.955727:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788666756.955730:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff937066b54d40) has no exports 00000020:00000080:2.0:1788666756.955737:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a336 00000020:00000080:2.0:1788666756.955742:0:20768:0:(genops.c:885:class_export_put()) final put ffff93707b948000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788666756.956084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f437a1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788666756.956767:0:20768:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788666756.956773:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788666756.956777:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1788666756.956782:0:20768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788666756.956784:0:20768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788666756.957341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b948000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788666756.957477:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666756.957486:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788666756.957494:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a328 00000020:00000080:2.0:1788666756.957501:0:20768:0:(genops.c:885:class_export_put()) final put ffff93707f618000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788666756.957505:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788666756.957509:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666756.957513:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1788666756.957584:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93707b94d000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788666756.957590:0:36:0:(genops.c:885:class_export_put()) final put ffff93707f618800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666756.957592:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93707f618800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788666756.957597:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788666756.957682:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93707f618000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00080000:2.0:1788666756.957709:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93706f0119c0) has no exports 00000020:00000080:2.0:1788666756.957716:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a321 00000020:00000080:2.0:1788666756.957720:0:20768:0:(genops.c:885:class_export_put()) final put ffff93707f61d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788666756.957930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93707f61d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788666756.958276:0:20768:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788666756.958280:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788666756.958292:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788666756.958296:0:20768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788666756.958298:0:20768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788666756.958437:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666756.958444:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788666756.958456:0:20768:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788666756.958461:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a313 00000020:00000080:2.0:1788666756.958467:0:20768:0:(genops.c:885:class_export_put()) final put ffff93707b94c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666756.958966:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93707f61e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788666756.958974:0:36:0:(genops.c:885:class_export_put()) final put ffff93707b94b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666756.958976:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b94b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788666756.958982:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788666756.959151:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788666756.959157:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666756.959163:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788666756.959167:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff937066b50000) has no exports 00000020:00000080:2.0:1788666756.959172:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a30c 00000020:00000080:2.0:1788666756.959177:0:20768:0:(genops.c:885:class_export_put()) final put ffff937074b3e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788666756.959483:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b94c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788666756.960629:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff937074b3e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788666756.976209:0:20768:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788666756.976217:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788666756.976221:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788666756.976228:0:20768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788666756.976340:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666756.976353:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788666756.976388:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666756.976393:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788666756.976398:0:20768:0:(genops.c:885:class_export_put()) final put ffff937066867800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788666756.976403:0:20768:0:(genops.c:844:class_export_destroy()) destroying export ffff937066867800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788666756.976411:0:20768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788666756.976508:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a2e2 00000020:00000080:2.0:1788666756.976515:0:20768:0:(genops.c:885:class_export_put()) final put ffff936f437a6800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788666756.976655:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937074b3c000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788666756.976662:0:36:0:(genops.c:885:class_export_put()) final put ffff93707f61f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666756.976664:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93707f61f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788666756.976671:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788666756.977223:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788666756.977230:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666756.977237:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788666756.977241:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93707b5119c0) has no exports 00000020:00000080:2.0:1788666756.977263:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666756.977276:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788666756.977280:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a2e9 00000020:00000080:2.0:1788666756.977286:0:20768:0:(genops.c:885:class_export_put()) final put ffff936f437a3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788666756.977385:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f437a6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788666756.977390:0:36:0:(genops.c:885:class_export_put()) final put ffff937066863000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788666756.977392:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff937066863000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788666756.977396:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788666756.977822:0:20768:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937043c8d800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788666756.977827:0:20768:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937043c8d800 3 00000020:01000004:2.0:1788666756.977830:0:20768:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff937043c8d800 from lustre-MDT0000 00000020:00000080:2.0:1788666756.977968:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666756.977973:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788666756.977976:0:20768:0:(genops.c:885:class_export_put()) final put ffff937066865000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788666756.977978:0:20768:0:(genops.c:844:class_export_destroy()) destroying export ffff937066865000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788666756.977984:0:20768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788666756.978028:0:20768:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788666756.978032:0:20768:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788666756.978034:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788666756.978037:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666756.978039:0:20768:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788666756.978045:0:20768:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff936f4454c000 09eda017-c07c-40fa-9b24-23f5903ec822 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788666756.978051:0:20768:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93706f010000) has exports, disconnecting them 00000020:00080000:2.0:1788666756.978055:0:20768:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff936f4454c000), last request at 1788666675 00000020:00000080:2.0:1788666756.978068:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a28e 00000020:00010000:2.0:1788666756.978072:0:20768:0:(genops.c:1921:obd_stale_export_put()) Put export ffff936f4454c000: total 1 00000100:00080000:2.0:1788666756.978076:0:20768:0:(import.c:65:import_set_state_nolock()) ffff936f4454f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788666756.978125:0:20768:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff936f4454c000): rc 0 00000020:00080000:2.0:1788666756.978130:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93706f010000) has no exports 00000020:00000080:1.0:1788666756.978192:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f437a3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788666756.978230:0:18353:0:(genops.c:1907:obd_stale_export_get()) Get export ffff936f4454c000: total 0 00010000:00010000:0.0:1788666756.978265:0:18353:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff936f4454c000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788666756.978291:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937040031e00/0x4267b949b564a83e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a837 expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978306:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937040031600/0x4267b949b564a84c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a845 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978391:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93704dd0ce00/0x4267b949b564a4ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a4e8 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978403:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375fe00/0x4267b949b564a85a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a853 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978416:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375e800/0x4267b949b564a64d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a646 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978439:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f43338600/0x4267b949b564a3ad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a3a6 expref: 9 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978450:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f43338a00/0x4267b949b564a46a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a463 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978460:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93704dd0c000/0x4267b949b564a3bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a3b4 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978470:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4451e800/0x4267b949b564a3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a3c2 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978480:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375f000/0x4267b949b564a677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a670 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978489:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375e200/0x4267b949b564a29c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a295 expref: 4 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978499:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a2e00/0x4267b949b564a6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a6af expref: 3 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666756.978510:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4451ea00/0x4267b949b564a519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4267b949b564a512 expref: 2 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666756.978647:0:17193:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff936f4363d800:17193] 1 exiting: rc = 0 00000100:00100000:3.0:1788666756.978734:0:17194:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff937048503400:17194] 2 exiting: rc = 0 00000100:00100000:3.0:1788666756.978870:0:17192:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff936f4363c000:17192] 0 exiting: rc = 1 00010000:00010000:0.0:1788666756.979125:0:18353:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff936f4454c000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788666756.979145:0:18353:0:(genops.c:885:class_export_put()) final put ffff936f4454c000/09eda017-c07c-40fa-9b24-23f5903ec822 00010000:00010000:0.0:1788666756.979157:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666756.979159:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666756.979160:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788666756.979178:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4454c000/09eda017-c07c-40fa-9b24-23f5903ec822 for MGS 00000020:00000080:0.0:1788666756.979205:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f4454f800 for MGS 00000100:00100000:2.0:1788666756.979652:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979659:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979665:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979671:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979677:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979682:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979687:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979692:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979707:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979713:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979717:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979722:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979727:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979732:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979737:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979742:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979747:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979752:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979757:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979762:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979767:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979772:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979777:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979782:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979787:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979791:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979796:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979944:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979953:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979958:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979963:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979968:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979973:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979977:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979982:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979986:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979992:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.979997:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980002:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980007:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980013:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980018:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980023:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980036:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980041:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980046:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980051:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980056:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980061:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980066:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980072:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980076:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980081:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980086:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980090:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980095:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980100:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980105:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980111:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980117:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980123:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980128:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980134:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666756.980140:0:20768:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788666756.981603:0:20768:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff936f431e9d20 - data ffff937065d6a510/ffff936f43ef7800 00000020:01000000:2.0:1788666756.981714:0:20768:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff936f425c03c0 - data ffff937049afebd0/ffff93707b707400 00000020:00000080:2.0:1788666756.982212:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a272 00000020:00000080:2.0:1788666756.982221:0:20768:0:(genops.c:885:class_export_put()) final put ffff936f43f75000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788666756.982274:0:20768:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937043c8d800 from MGS, refs=2 00000020:01000004:2.0:1788666756.982278:0:20768:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937043c8d800 2 00000020:01000004:2.0:1788666756.982281:0:20768:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff937043c8d800 from MGS 00000020:00000080:2.0:1788666756.982300:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666756.982306:0:20768:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788666756.982309:0:20768:0:(genops.c:885:class_export_put()) final put ffff936f43f77000/MGS 00000020:00000080:2.0:1788666756.982328:0:20768:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43f77000/MGS for MGS 00000020:01000000:2.0:1788666756.982336:0:20768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788666756.982393:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788666756.982405:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666756.982411:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788666756.982417:0:20768:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff937044122800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788666756.982423:0:20768:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff937066b53380) has exports, disconnecting them 00000020:00080000:2.0:1788666756.982428:0:20768:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff937044122800), last request at 1788666675 00000020:00000080:2.0:1788666756.982432:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a375 00000020:00080000:2.0:1788666756.982442:0:20768:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937044122800): rc 0 00000020:00000080:2.0:1788666756.982446:0:20768:0:(genops.c:885:class_export_put()) final put ffff937044122800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788666756.982646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43f75000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788666756.983405:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff937044122800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788666756.995881:0:20768:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788666756.995890:0:20768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788666756.995894:0:20768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788666756.995902:0:20768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788666756.996067:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666756.996075:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788666756.996082:0:20768:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937043c8d800 1 00000020:00000080:0.0:1788666756.996088:0:20768:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a264 00000020:00000080:0.0:1788666756.996096:0:20768:0:(genops.c:885:class_export_put()) final put ffff936f43f74800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788666756.996102:0:20768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788666756.996108:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666756.996112:0:20768:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788666756.996115:0:20768:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93707c60b380) has no exports 00000020:00000080:1.0:1788666756.996426:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937044127000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788666756.996433:0:8:0:(genops.c:885:class_export_put()) final put ffff937044124800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788666756.996436:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff937044124800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788666756.996442:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788666756.996538:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43f74800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788666757.021688:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788666757.028770:0:20768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666757.028782:0:20768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788666757.028787:0:20768:0:(genops.c:885:class_export_put()) final put ffff937043c8e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788666757.028791:0:20768:0:(genops.c:844:class_export_destroy()) destroying export ffff937043c8e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788666757.028800:0:20768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788666757.028925:0:20768:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff937043c8f000 00000020:02000400:0.0:1788666757.028986:0:20768:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788666758.044130:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666759.069080:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666759.069100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525052928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788666759.069158:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666759.072587:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525052928 00000100:00100000:0.0:1788666759.072604:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525052928 00000100:00100000:0.0:1788666759.072679:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788666759.072690:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525052928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788666759.072722:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788666759.073022:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525052928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 269us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666759.073043:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788666759.073164:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525052928:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788666759.073241:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788666759.074520:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788666759.579977:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666759.579983:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788666759.579986:0:8:0:(import.c:65:import_set_state_nolock()) ffff936f43edd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666759.579995:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 577 00000100:00080000:1.0:1788666759.580001:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788666759.580007:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff936f43edd000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666759.580028:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43761500 x1875552525053184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666759.580050:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666759.580053:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788666759.580055:0:8:0:(import.c:65:import_set_state_nolock()) ffff937065bba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666759.580058:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 577 00000100:00080000:1.0:1788666759.580060:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788666759.580063:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff937065bba000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666759.580073:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43762300 x1875552525053440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666759.580081:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666759.580084:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788666759.580086:0:8:0:(import.c:65:import_set_state_nolock()) ffff936f42366000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666759.580089:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 577 00000100:00080000:1.0:1788666759.580098:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788666759.580101:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff936f42366000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666759.580113:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43760a80 x1875552525053568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666759.580136:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666759.580139:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788666759.580141:0:8:0:(import.c:65:import_set_state_nolock()) ffff936f4336a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666759.580144:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 577 00000100:00080000:1.0:1788666759.580147:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788666759.580150:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff936f4336a800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666759.580158:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43760e00 x1875552525053824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666759.580189:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525053312:0@lo:400:kworker.0 00000100:00100000:1.0:1788666759.580249:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666759.580300:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788666759.580317:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09eda017-c07c-40fa-9b24-23f5903ec822:3641:1875552525053056:0@lo:400:kworker.0 00000400:00000100:1.0:1788666759.580336:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875552525053056 offset 0 length 224: 4 00000100:00100000:1.0:1788666759.580363:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525053184:0@lo:38:kworker.0 00000100:00100000:1.0:1788666759.580398:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666759.580416:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875552525053440:0@lo:38:kworker.0 00000100:00100000:1.0:1788666759.580438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666759.580455:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875552525053568:0@lo:38:kworker.0 00000100:00100000:1.0:1788666759.580473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666759.580487:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875552525053824:0@lo:38:kworker.0 00000100:00100000:1.0:1788666759.580514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666759.580543:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525053696:0@lo:400:kworker.0 00000100:00100000:1.0:1788666759.580566:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666759.580585:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666759.580590:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525053952:0@lo:400:kworker.0 00000100:00100000:1.0:1788666759.580622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666759.580651:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525053312 00000100:00100000:1.0:1788666759.580658:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525053312 00000100:00100000:1.0:1788666759.580705:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788666759.580713:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525053312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666759.580756:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525053312:12345-0@lo:400:kworker.0 Request processed in 43us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666759.580763:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788666759.580780:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525053184 00000100:00100000:1.0:1788666759.580783:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525053184 00000100:00100000:1.0:1788666759.580798:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788666759.580803:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875552525053184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788666759.580820:0:17205:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788666759.582925:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525053440 00000100:00100000:0.0:1788666759.582937:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525053440 00000100:00100000:0.0:1788666759.582965:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525053568 00000100:00100000:0.0:1788666759.582968:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525053568 00000100:00100000:0.0:1788666759.582977:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525053824 00000100:00100000:0.0:1788666759.582979:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525053824 00000100:00100000:0.0:1788666759.582985:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525053696 00000100:00100000:0.0:1788666759.582987:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525053696 00000100:00100000:0.0:1788666759.583010:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525053952 00000100:00100000:0.0:1788666759.583012:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525053952 00000100:00100000:0.0:1788666759.583030:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788666759.583038:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707bf98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525053696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666759.583123:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707bf98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525053696:12345-0@lo:400:kworker.0 Request processed in 85us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666759.583130:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788666759.583146:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788666759.583152:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875552525053952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666759.583180:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875552525053952:12345-0@lo:400:kworker.0 Request processed in 28us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666759.583185:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788666759.583195:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788666759.583199:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875552525053440:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788666759.583217:0:20337:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788666759.583247:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875552525053440:12345-0@lo:38:kworker.0 Request processed in 47us (2808us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788666759.583265:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788666759.583277:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788666759.583280:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875552525053568:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788666759.583290:0:20337:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788666759.583325:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875552525053568:12345-0@lo:38:kworker.0 Request processed in 43us (2851us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788666759.583331:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788666759.583342:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788666759.583345:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875552525053824:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788666759.583354:0:20337:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788666759.583378:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875552525053824:12345-0@lo:38:kworker.0 Request processed in 30us (2862us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788666759.583461:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1788666759.583564:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff936f43761c00 x1875552525053952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666759.583579:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525053952:0@lo:400:kworker.0 00010000:00080000:3.0:1788666759.583589:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff936f43761180 x1875552525053696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666759.583598:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525053696:0@lo:400:kworker.0 00000100:00080000:2.0:1788666759.585659:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788666759.585667:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788666759.586796:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525053312:0@lo:400:kworker.0 00000100:00100000:3.0:1788666759.589962:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666759.589983:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525054080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788666759.590057:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666759.590101:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525054080 00000100:00100000:3.0:1788666759.590107:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525054080 00000100:00100000:3.0:1788666759.590149:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788666759.590156:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525054080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788666759.590182:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788666759.590221:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525054080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666759.590227:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788666759.590271:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525054080:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788666759.592217:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937065bba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666759.592230:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788666759.592234:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875552525053440:0@lo:38:kworker.0 00000100:00080000:0.0:1788666759.592245:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f42366000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666759.592249:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788666759.592252:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875552525053568:0@lo:38:kworker.0 00000100:00080000:0.0:1788666759.592261:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f4336a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666759.592264:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788666759.592266:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875552525053824:0@lo:38:kworker.0 00000100:00080000:0.0:1788666759.623686:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f43edd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788666759.623702:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875552525053184:12345-0@lo:38:kworker.0 Request processed in 42881us (43286us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788666759.623710:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788666759.623725:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525053184:0@lo:38:kworker.0 00000100:00100000:1.0:1788666759.623733:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:2.0:1788666760.096074:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788666760.681825:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788666760.707106:0:20969:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:2.0:1788666760.731856:0:20969:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788666760.731931:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.731950:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.731959:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.731967:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.731991:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788666760.731997:0:20969:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788666760.732037:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666760.732044:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.732069:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f43339000 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788666760.732073:0:17188:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.732083:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666760.732091:0:17188:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666760.732098:0:17188:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788666760.732100:0:17188:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788666760.732103:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788666760.733246:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.733259:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666760.733317:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.733325:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f43339000/0x4267b949b564a463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a46a expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.733339:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666760.733341:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666760.733344:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666760.734208:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666760.734239:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09eda017-c07c-40fa-9b24-23f5903ec822:3640:1875552525054208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666760.734337:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788666760.735606:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666760.735613:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788666760.735621:0:20969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788666760.735628:0:20969:0:(import.c:65:import_set_state_nolock()) ffff937065bba000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788666760.735635:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666760.735637:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788666760.735640:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788666760.739557:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739580:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739588:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739595:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739613:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666760.739620:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739626:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739633:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739639:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739675:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788666760.739695:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666760.739702:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739710:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375f400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788666760.739714:0:17187:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739722:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666760.739731:0:17187:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666760.739737:0:17187:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788666760.739740:0:17187:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788666760.739789:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739795:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666760.739822:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739830:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4375f400/0x4267b949b564a3c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a3c9 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739880:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666760.739884:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739895:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4451ee00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788666760.739899:0:17187:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739906:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666760.739912:0:17187:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666760.739917:0:17187:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788666760.739919:0:17187:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788666760.739921:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788666760.739936:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739941:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666760.739946:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739953:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4451ee00/0x4267b949b564a6af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a6b6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666760.739965:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666760.739967:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666760.739969:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666760.739990:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09eda017-c07c-40fa-9b24-23f5903ec822:3639:1875552525054464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666760.740067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666760.740271:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09eda017-c07c-40fa-9b24-23f5903ec822:3638:1875552525054336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666760.740556:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666760.740937:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525054208 00000100:00100000:1.0:1788666760.740947:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525054208 00000100:00100000:1.0:1788666760.740994:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525054464 00000100:00100000:1.0:1788666760.740998:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525054464 00000100:00100000:1.0:1788666760.741035:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666760.741043:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1875552525054208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788666760.741050:0:17184:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788666760 with bad export cookie 4784996855331463822 00000100:00100000:0.0:1788666760.741224:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666760.742223:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525054336 00000100:00100000:3.0:1788666760.742233:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525054336 00000100:00100000:3.0:1788666760.742273:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666760.742280:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1875552525054464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788666760.742287:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788666760 with bad export cookie 4784996855331463822 00000100:00100000:3.0:1788666760.742432:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1875552525054464:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (2363us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788666760.742440:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666760.742463:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788666760.742467:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f600000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1875552525054336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788666760.742471:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788666760 with bad export cookie 4784996855331463822 00000100:00080000:2.0:1788666760.742654:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788666760.742674:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9370446c8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788666760.742679:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788666760.742719:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f600000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1875552525054336:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (1495us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788666760.742726:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788666760.745067:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.745088:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.745095:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.745103:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.745142:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666760.745149:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.745157:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.745164:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.745170:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.745182:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788666760.745187:0:20969:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788666760.745196:0:20969:0:(mgc_request.c:545:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788666760.745245:0:20969:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788666760.745249:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788666760.745255:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666760.745277:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788666760.745284:0:20969:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff936f4336c000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788666760.745291:0:20969:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff936f43c72800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788666760.745296:0:20969:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff93707c6099c0) has exports, disconnecting them 00000020:00080000:3.0:1788666760.745313:0:20969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff936f4336c000), last request at 1788666759 00000020:00000080:3.0:1788666760.745322:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a6a1 00000100:00080000:3.0:1788666760.745342:0:20969:0:(import.c:65:import_set_state_nolock()) ffff936f4336f800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788666760.745414:0:20969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff936f4336c000): rc 0 00000020:00000080:3.0:1788666760.745417:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f4336c000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788666760.745433:0:20969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff936f43c72800), last request at 1788666759 00000020:00000080:3.0:1788666760.745436:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a543 00000100:00080000:3.0:1788666760.745442:0:20969:0:(import.c:65:import_set_state_nolock()) ffff936f43c71000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788666760.745448:0:20969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff936f43c72800): rc 0 00000020:00000080:3.0:1788666760.745450:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f43c72800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788666760.745457:0:20969:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa7e941dd3ae8 00000100:00080000:3.0:1788666760.745478:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788666760.745487:0:20969:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff93707f5e1180 x1875552525052288/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788666770 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666760.745498:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788666760.746799:0:20969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788666760.746810:0:20969:0:(import.c:65:import_set_state_nolock()) ffff936f43edd000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788666760.752311:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788666760.753484:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788666760.753493:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000100:00100000:1.0:1788666760.753503:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1875552525054208:12345-0@lo:103:ldlm_bl.0 Request processed in 12455us (19162us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788666760.753521:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788666760.753534:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788666760.753603:0:20969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788666760.753630:0:20969:0:(import.c:65:import_set_state_nolock()) ffff93704aeba000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788666760.753665:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788666760.753668:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788666760.753689:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788666760.753763:0:20969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788666760.753776:0:20969:0:(import.c:65:import_set_state_nolock()) ffff93707b727800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788666760.753813:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff93707c6099c0) has no exports 00000100:00100000:1.0:1788666760.754520:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525054592:0@lo:9:umount.0 00000100:00100000:1.0:1788666760.754584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666760.754621:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525054720:0@lo:9:umount.0 00000100:00100000:1.0:1788666760.754643:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666760.754688:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525054592 00000100:00100000:1.0:1788666760.754696:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525054592 00000100:00100000:1.0:1788666760.754755:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525054720 00000100:00100000:1.0:1788666760.754759:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525054720 00000100:00100000:1.0:1788666760.754786:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788666760.754795:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875552525054592:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788666760.754827:0:18705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a631 00000100:00080000:1.0:1788666760.754866:0:18705:0:(import.c:65:import_set_state_nolock()) ffff936f42363000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788666760.754921:0:18705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788666760.755094:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3637:x1875552525054592:12345-0@lo:9:umount.0 Request processed in 299us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666760.755101:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788666760.755296:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788666760.755317:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875552525054720:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788666760.755332:0:18705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a6d2 00000100:00080000:1.0:1788666760.755338:0:18705:0:(import.c:65:import_set_state_nolock()) ffff93707f5b6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788666760.755355:0:18705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788666760.755455:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3637:x1875552525054720:12345-0@lo:9:umount.0 Request processed in 141us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666760.755468:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788666760.755649:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93704aeba000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788666760.755664:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788666760.755667:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788666760.755671:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525054592:0@lo:9:umount.0 00000100:00080000:1.0:1788666760.755686:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93707b727800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788666760.755698:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788666760.755700:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788666760.755702:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525054720:0@lo:9:umount.0 00000020:00000080:1.0:1788666760.759902:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4336c000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788666760.759983:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43c72800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788666760.760010:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f4336f800 for lustre-MDT0001 00000020:00000080:1.0:1788666760.760016:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f43c71000 for lustre-MDT0001 00010000:00010000:1.0:1788666760.760032:0:18353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666760.760042:0:18353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666760.760055:0:18353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666760.760060:0:18353:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666760.760073:0:18353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666760.760083:0:18353:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666760.760129:0:18353:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788666760.760133:0:18353:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788666760.760137:0:18353:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788666760.763565:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666760.763583:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.763597:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375ee00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:3.0:1788666760.763601:0:17188:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.763613:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666760.763623:0:17188:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666760.763629:0:17188:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788666760.763632:0:17188:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788666760.763636:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1788666760.765930:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.134@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788666760.765938:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788666760.765950:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff936f43762680 x1875552525053056/t0(0) o400->MGC192.168.206.134@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788666775 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666760.765989:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff936f43fe1180 x1875552525054208/t0(0) o103->MGC192.168.206.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788666776 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666760.766001:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff936f43fe2a00 x1875552525054464/t0(0) o103->MGC192.168.206.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788666776 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666760.766010:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff936f43fe3100 x1875552525054336/t0(0) o103->MGC192.168.206.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788666776 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788666760.766020:0:3639:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788666760.766023:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788666760.766024:0:3639:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788666760.766245:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9370446c8800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788666760.766409:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f5e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525052288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666760.766453:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09eda017-c07c-40fa-9b24-23f5903ec822:3638:1875552525054336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666760.766607:0:18353:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666760.766617:0:18353:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666760.766634:0:18353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666760.766641:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a3200/0x4267b949b564a853 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a85a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666760.766657:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666760.766659:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666760.766661:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666760.766703:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.766711:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788666760.766719:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.766725:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4375ee00/0x4267b949b564a3b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4267b949b564a3bb expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666760.766821:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666760.766823:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666760.766825:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666760.766954:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09eda017-c07c-40fa-9b24-23f5903ec822:0:1875552525054848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666760.766974:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09eda017-c07c-40fa-9b24-23f5903ec822:3640:1875552525054208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666760.766991:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666760.766996:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09eda017-c07c-40fa-9b24-23f5903ec822:0:1875552525054976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666760.767016:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09eda017-c07c-40fa-9b24-23f5903ec822:3641:1875552525053056:0@lo:400:kworker.0 00010000:00010000:3.0:1788666760.768223:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788666760.768639:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9370446c8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788666760.768651:0:3639:0:(import.c:545:import_select_connection()) MGC192.168.206.134@tcp: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1788666760.768662:0:3639:0:(import.c:665:import_select_connection()) MGC192.168.206.134@tcp: import ffff9370446c8800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:2.0:1788666760.768722:0:3639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43fe3b80 x1875552525055104/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788666760.768947:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:09eda017-c07c-40fa-9b24-23f5903ec822:3637:1875552525055104:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788666760.769007:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875552525055104 offset 0 length 520: 4 00000100:00100000:2.0:1788666760.769068:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09eda017-c07c-40fa-9b24-23f5903ec822:3639:1875552525054464:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788666760.777972:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff93707c6099c0) has no exports 00000020:01000000:2.0:1788666760.840232:0:20969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff936f431e9420 - data ffff937065c3c5e8/ffff936f43ef5400 00000020:01000000:2.0:1788666760.840401:0:20969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93705ddd52a0 - data ffff937065c1f6c0/ffff93707bfa0c00 00000001:00000004:2.0:1788666760.846897:0:20969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788666760.910311:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666760.910320:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788666760.910328:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788666760.917438:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788666760.917447:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788666760.917460:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788666760.917463:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788666760.918799:0:17940:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788666760.918808:0:17940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788666760.918823:0:17940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788666760.919507:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788666760.919513:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788666760.919525:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788666760.919527:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788666760.920205:0:17942:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788666760.920210:0:17942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788666760.920220:0:17942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788666760.921183:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a3d7 00000020:00000080:2.0:1788666760.921195:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f43ed5800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788666760.921935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43ed5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788666760.924264:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a3ec 00000020:00000080:0.0:1788666760.924281:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f43ed9800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788666760.924313:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788666760.924320:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666760.924332:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788666760.924337:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93707c608000) has no exports 00000004:01000000:0.0:1788666760.924552:0:20969:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788666760.924562:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a440 00000020:00000080:0.0:1788666760.924567:0:20969:0:(genops.c:885:class_export_put()) final put ffff93707f5b4800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788666760.924572:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788666760.924576:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666760.924581:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788666760.924584:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff93705101b380) has no exports 00000020:00000080:0.0:1788666760.924591:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a439 00000020:00000080:0.0:1788666760.924595:0:20969:0:(genops.c:885:class_export_put()) final put ffff93707b725000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788666760.925024:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43ed9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1788666760.925035:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93707f5b4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788666760.925040:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b725000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788666760.925238:0:20969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788666760.925244:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788666760.925250:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788666760.925256:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788666760.925259:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788666760.925344:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666760.925352:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788666760.925360:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a42b 00000020:00000080:0.0:1788666760.925367:0:20969:0:(genops.c:885:class_export_put()) final put ffff93707b722000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788666760.926237:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93707b727800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788666760.926248:0:37:0:(genops.c:885:class_export_put()) final put ffff93707b723800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788666760.926251:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b723800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788666760.926260:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788666760.926493:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788666760.926591:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b722000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788666760.926623:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788666760.926634:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788666760.926639:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93707b513380) has no exports 00000020:00000080:1.0:1788666760.926648:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a41d 00000020:00000080:1.0:1788666760.926655:0:20969:0:(genops.c:885:class_export_put()) final put ffff93704aebe800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788666760.927327:0:20969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788666760.927334:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788666760.927338:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788666760.927344:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788666760.927347:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788666760.927395:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93704aebe800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788666760.927759:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788666760.927781:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788666760.927802:0:20969:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788666760.927810:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a40f 00000020:00000080:1.0:1788666760.927818:0:20969:0:(genops.c:885:class_export_put()) final put ffff93704ded3000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788666760.927825:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788666760.928086:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788666760.928093:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788666760.928098:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff937051018000) has no exports 00000020:00000080:1.0:1788666760.928106:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a408 00000020:00000080:1.0:1788666760.928111:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f43ede000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788666760.929120:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93704aeba000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788666760.929132:0:37:0:(genops.c:885:class_export_put()) final put ffff937074b46000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788666760.929135:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff937074b46000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788666760.929142:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788666760.929248:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93704ded3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788666760.929253:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43ede000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788666760.930312:0:20969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788666760.930319:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788666760.930325:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788666760.930333:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788666760.930395:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666760.930407:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788666760.930442:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666760.930446:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788666760.930451:0:20969:0:(genops.c:885:class_export_put()) final put ffff937066860800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788666760.930456:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff937066860800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788666760.930463:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788666760.930621:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a3f3 00000020:00000080:0.0:1788666760.930638:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f43ed8800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788666760.930643:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788666760.930646:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666760.930651:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788666760.930655:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93707c60cd40) has no exports 00000020:00000080:0.0:1788666760.930685:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666760.930688:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788666760.930693:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a3fa 00000020:00000080:0.0:1788666760.930698:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f43ed8000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788666760.930706:0:20969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff936f4236d000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788666760.930710:0:20969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936f4236d000 2 00000020:01000004:0.0:1788666760.930714:0:20969:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff936f4236d000 from lustre-MDT0001 00000020:00000080:0.0:1788666760.930734:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666760.930737:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788666760.930741:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f43ed4000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788666760.930743:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43ed4000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788666760.930752:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788666760.930782:0:20969:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788666760.930786:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788666760.930789:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666760.930794:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788666760.930801:0:20969:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff937065bba800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788666760.930807:0:20969:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff93705101cd40) has exports, disconnecting them 00000020:00080000:0.0:1788666760.930813:0:20969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff937065bba800), last request at 1788666687 00000020:00000080:0.0:1788666760.930817:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a478 00000020:00080000:0.0:1788666760.930856:0:20969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff937065bba800): rc 0 00000020:00000080:0.0:1788666760.930861:0:20969:0:(genops.c:885:class_export_put()) final put ffff937065bba800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788666760.930945:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f43edd000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788666760.930955:0:37:0:(genops.c:885:class_export_put()) final put ffff936f43080000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788666760.930957:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43080000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788666760.930962:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788666760.931053:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43ed8800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788666760.931057:0:37:0:(genops.c:885:class_export_put()) final put ffff936f43084000/lustre-MDD0001_UUID 00000020:00000080:2.0:1788666760.931059:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43084000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788666760.931063:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788666760.931162:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43ed8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788666760.931166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff937065bba800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788666760.946144:0:20969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788666760.946157:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666760.946162:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788666760.946171:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788666760.946219:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff937065bba000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788666760.946474:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666760.946486:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788666760.946492:0:20969:0:(genops.c:885:class_export_put()) final put ffff93707b724800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788666760.946496:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff93707b724800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788666760.946504:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788666760.946605:0:20969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936f4236d000 1 00000020:00000080:2.0:1788666760.946613:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a39f 00000020:00000080:2.0:1788666760.946620:0:20969:0:(genops.c:885:class_export_put()) final put ffff9370523cc000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788666760.946630:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788666760.946638:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9370523cc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788666760.946648:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666760.946654:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788666760.946657:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff93707b514d40) has no exports 00000020:00000080:0.0:1788666761.099828:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666761.099874:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788666761.099881:0:20969:0:(genops.c:885:class_export_put()) final put ffff936f4236f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788666761.099887:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4236f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788666761.099915:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788666761.100072:0:20969:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff936f4236c000 00000020:01000000:0.0:1788666761.100095:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788666761.100100:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666761.100105:0:20969:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788666761.100109:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff936f4337cd40) has no exports 00000100:00100000:0.0:1788666761.100225:0:17200:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9370435a8200:17200] 1 exiting: rc = 0 00000100:00100000:0.0:1788666761.100373:0:17199:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9370435a8e00:17199] 0 exiting: rc = 1 00000100:00100000:0.0:1788666761.100466:0:17201:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff937074adda00:17201] 2 exiting: rc = 0 00000100:00100000:1.0:1788666761.100798:0:20337:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff936f42132a00:20337] 3 exiting: rc = 0 00000100:00100000:0.0:1788666761.101110:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101118:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101125:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101132:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101138:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101145:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101151:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101157:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101164:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101171:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101176:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101181:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101189:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101197:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101204:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101211:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101217:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.101224:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106614:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106652:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106659:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106666:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106672:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106678:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106684:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106715:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106721:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106727:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106734:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106879:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106887:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106896:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106905:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106911:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106916:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106923:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106930:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106938:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106945:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106954:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106960:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106967:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106973:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106979:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106986:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.106994:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107001:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107008:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107014:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107021:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107027:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107034:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107041:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107047:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107053:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107060:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107066:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107072:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107078:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107084:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107102:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107108:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107115:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.107121:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788666761.116072:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666761.123190:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93704642c200:17202] 0 exiting: rc = 1 00000100:00100000:2.0:1788666761.126000:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93704642dc00:17203] 1 exiting: rc = 0 00000100:00100000:0.0:1788666761.126207:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126217:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126226:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126243:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126249:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126255:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126261:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126267:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126273:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126279:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126284:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126290:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126296:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126312:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126318:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126325:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126331:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126336:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126342:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126348:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126354:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126372:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126378:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126384:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126390:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126396:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126402:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126407:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126414:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126420:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126434:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126440:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126446:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126452:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126458:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126463:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126469:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126474:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126479:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126484:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126490:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126495:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126501:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126506:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126511:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126517:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126522:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126527:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126533:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126538:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126543:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126549:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126554:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126560:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126565:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126571:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126577:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126583:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126589:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126594:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126602:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126607:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126613:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.126619:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.127193:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93707b69a400:17204] 0 exiting: rc = 1 00000100:00100000:2.0:1788666761.127626:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93707b69ba00:17205] 1 exiting: rc = 0 00000100:00100000:3.0:1788666761.127777:0:20153:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff936f43000800:20153] 2 exiting: rc = 0 00000100:00100000:1.0:1788666761.135043:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135071:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135078:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135086:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135190:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135202:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135209:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135216:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135224:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135231:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135237:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135244:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135261:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135270:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135276:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135283:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135322:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135331:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135337:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135345:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135351:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135358:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135503:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135509:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135516:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135522:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135539:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135546:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135569:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135579:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135587:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135594:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135601:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135608:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135615:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135621:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135629:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135636:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135643:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135650:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135672:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135682:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135689:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135695:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135702:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135710:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135718:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135724:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135732:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135751:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135760:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135774:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135798:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135806:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135814:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.135821:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.136035:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.136105:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.136183:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.136192:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.136199:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.136206:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.136213:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.136220:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666761.148724:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93707b69b600:17206] 0 exiting: rc = 1 00000100:00100000:0.0:1788666761.148724:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93707b69c200:17207] 1 exiting: rc = 0 00000100:00100000:1.0:1788666761.148890:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148898:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148904:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148910:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148916:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148922:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148928:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148933:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148938:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148943:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148948:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148954:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148959:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148965:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148972:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148978:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148983:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148989:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.148994:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149000:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149005:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149010:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149015:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149020:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149025:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149030:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149035:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149040:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149063:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149068:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149074:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149079:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149083:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149089:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149094:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149107:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149296:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149317:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149323:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149329:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149335:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149341:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149346:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149352:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149357:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149363:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149368:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149383:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149389:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149394:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149399:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149405:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149409:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149414:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149420:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149425:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149430:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149435:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149440:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149444:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149449:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149455:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149460:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.149475:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666761.149860:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93707b69cc00:17209] 1 exiting: rc = 0 00000100:00100000:1.0:1788666761.149863:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff937065bdde00:17208] 0 exiting: rc = 1 00000100:00100000:1.0:1788666761.150099:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150106:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150112:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150128:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150133:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150139:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150144:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150150:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150156:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150161:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150166:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150172:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150177:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150186:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150192:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150198:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150203:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150209:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150214:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150219:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150224:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150230:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150235:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150241:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150246:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150251:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150256:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150262:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150267:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150273:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150279:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150285:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150290:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150318:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150323:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150329:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150334:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150340:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150346:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150352:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150357:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150363:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150378:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150385:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150391:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150395:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150401:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150405:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150410:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150415:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150421:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150426:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150431:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150437:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150442:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150448:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150453:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150459:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150464:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150469:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150475:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150480:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150486:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.150491:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666761.151079:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93707f5f5c00:17210] 0 exiting: rc = 1 00000100:00100000:3.0:1788666761.151083:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93707f5f5000:17211] 1 exiting: rc = 0 00000100:00100000:0.0:1788666761.152208:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152218:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152223:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152229:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152235:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152241:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152247:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152253:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152258:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152264:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152270:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152276:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152281:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152287:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152293:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152310:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152316:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152322:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152329:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152335:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152340:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152345:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152350:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152355:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152359:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152364:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152369:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152439:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152445:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152450:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152457:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152461:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152467:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152473:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152495:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152500:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152506:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152511:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152516:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152521:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152526:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152531:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152536:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152541:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152547:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152552:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152558:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152564:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152569:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152575:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152581:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152586:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152591:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152597:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152603:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152608:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152613:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152619:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152624:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152629:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152635:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152641:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152646:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.152652:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666761.153612:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff937061a44c00:17212] 0 exiting: rc = 1 00000100:00100000:0.0:1788666761.153916:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93706f623200:17213] 1 exiting: rc = 0 00000100:00100000:0.0:1788666761.160024:0:17214:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93706f622600:17214] 2 exiting: rc = 0 00000100:00100000:0.0:1788666761.160201:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160210:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160216:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160241:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160248:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160254:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160280:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160288:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160295:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160309:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160316:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160322:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160329:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160336:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160343:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160349:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160355:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160361:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160367:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160435:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160442:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160449:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160456:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160462:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160468:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160474:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160480:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160486:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160493:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160499:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160519:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160526:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160532:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160540:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160546:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160552:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160558:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160564:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160576:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160582:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160588:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160595:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160601:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160607:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160613:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160619:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160625:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160630:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160636:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160642:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160647:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160653:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160658:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160664:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160683:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160689:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160695:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160701:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160707:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160713:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160719:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160725:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160732:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666761.160811:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788666761.168040:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666761.168056:0:20969:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788666761.168062:0:20969:0:(genops.c:885:class_export_put()) final put ffff9370446ce800/MDS_uuid 00000020:00000080:0.0:1788666761.168068:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff9370446ce800/MDS_uuid for MDS 00000020:01000000:0.0:1788666761.168074:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788666761.168348:0:20969:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788666762.140439:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666763.165469:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666764.192952:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788666764.700663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666764.700678:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666764.700681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666764.700684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788666764.700688:0:37:0:(import.c:65:import_set_state_nolock()) ffff936f42366000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666764.700695:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 582 00000100:00080000:1.0:1788666764.700701:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788666764.700707:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff936f42366000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666764.700739:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac5880 x1875552525055232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788666764.704552:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525055360:0@lo:400:kworker.0 00000400:00000100:0.0:1788666764.704607:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525055360 offset 0 length 224: 4 00000100:00080000:1.0:1788666764.704693:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666764.704698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788666764.704702:0:37:0:(import.c:65:import_set_state_nolock()) ffff936f4336a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666764.704706:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 582 00000100:00080000:1.0:1788666764.704711:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788666764.704717:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff936f4336a800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666764.704738:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac5180 x1875552525055488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788666764.704788:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875552525055616:0@lo:400:kworker.0 00000400:00000100:3.0:1788666764.704811:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525055616 offset 0 length 224: 4 00000100:00100000:3.0:1788666764.704876:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875552525055232:0@lo:38:kworker.0 00000400:00000100:3.0:1788666764.704896:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525055232 offset 0 length 520: 4 00000100:00100000:3.0:1788666764.704916:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875552525055488:0@lo:38:kworker.0 00000400:00000100:3.0:1788666764.704931:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525055488 offset 0 length 520: 4 00010000:00010000:3.0:1788666765.212052:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788666765.699109:0:21171:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:2.0:1788666765.712087:0:21171:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788666765.712146:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666765.712161:0:21171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666765.712168:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666765.712175:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666765.712194:0:21171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788666765.712199:0:21171:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788666765.712222:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666765.712234:0:21171:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff937074ac5880 x1875552525055232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788666784 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666765.712256:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788666765.712261:0:21171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788666765.712266:0:21171:0:(import.c:65:import_set_state_nolock()) ffff936f42366000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788666765.712364:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666765.712370:0:21171:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff937074ac5880 x1875552525055232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788666784 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666765.712378:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788666765.712393:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1788666765.712468:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875552525055232:0@lo:38:kworker.0 00010000:00010000:1.0:1788666765.713434:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666765.713443:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666765.713453:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4451f600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666765.713457:0:17187:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666765.713467:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666765.713485:0:17187:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666765.713490:0:17187:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788666765.713493:0:17187:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788666765.713495:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788666765.713509:0:17187:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9370446c8800 00010000:00010000:1.0:1788666765.713513:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666765.713520:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4451f600/0x4267b949b564a512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a519 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666765.713531:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666765.713533:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666765.713534:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788666765.715494:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788666765.715509:0:21171:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff937074ac7480 x1875552525055360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666780 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666765.715525:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788666765.715530:0:21171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788666765.715552:0:21171:0:(import.c:65:import_set_state_nolock()) ffff936f43594000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788666765.718060:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525055360:0@lo:400:kworker.0 00000100:00100000:3.0:1788666765.718229:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875552525055744:0@lo:39:umount.0 00000400:00000100:3.0:1788666765.718292:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525055744 offset 0 length 224: 4 00000100:00080000:1.0:1788666765.724086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666765.724095:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666765.724098:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666765.724101:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788666765.724219:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875552525055872:0@lo:400:kworker.0 00000400:00000100:0.0:1788666765.724270:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525055872 offset 0 length 224: 4 00010000:00010000:0.0:1788666766.236309:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788666766.750873:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788666766.750882:0:18701:0:(genops.c:885:class_export_put()) final put ffff936f42367000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788666766.750992:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f42367000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788666766.751042:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f42363000 for lustre-OST0000 00000001:00100000:1.0:1788666766.751647:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788666766.751651:0:19518:0:(genops.c:885:class_export_put()) final put ffff93707f5b0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788666766.751731:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93707f5b0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788666766.751762:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93707f5b6000 for lustre-OST0001 00010000:00010000:3.0:1788666767.260683:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666768.284037:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666769.308368:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666769.756947:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788666769.756958:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666769.756961:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788666769.756964:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788666769.757068:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875552525056000:0@lo:400:kworker.0 00000400:00000100:2.0:1788666769.757120:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525056000 offset 0 length 224: 4 00010000:00010000:3.0:1788666770.332548:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666770.847483:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666760/real 1788666760] req@ffff936f43fe3b80 x1875552525055104/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788666770 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666770.847531:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff936f43fe3b80 x1875552525055104/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788666770 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788666770.847562:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9370446c8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666770.847584:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788666770.847588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:09eda017-c07c-40fa-9b24-23f5903ec822:3637:1875552525055104:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1788666770.847896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788666770.847901:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788666770.847904:0:36:0:(import.c:65:import_set_state_nolock()) ffff9370446c8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666770.847909:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.134@tcp: connect to NID 0@lo last attempt 583 00000100:00080000:0.0:1788666770.847914:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.134@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788666770.847921:0:36:0:(import.c:665:import_select_connection()) MGC192.168.206.134@tcp: import ffff9370446c8800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666770.847949:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93707f600e00 x1875552525056128/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666770.847975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788666770.847979:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788666770.848136:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:09eda017-c07c-40fa-9b24-23f5903ec822:3637:1875552525056128:0@lo:250:kworker.0 00000400:00000100:3.0:1788666770.848179:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875552525056128 offset 0 length 520: 4 00000100:00100000:1.0:1788666770.848811:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525056256:0@lo:400:kworker.0 00000400:00000100:1.0:1788666770.848878:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525056256 offset 0 length 224: 4 00010000:00010000:1.0:1788666771.358501:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666772.380892:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666773.404411:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666774.432305:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666775.453038:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666775.963966:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666765/real 1788666765] req@ffff936f43fe2a00 x1875552525055744/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788666775 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666775.963997:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff936f43fe2a00 x1875552525055744/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788666775 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788666775.964016:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f43594000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788666775.964029:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875552525055744:0@lo:39:umount.0 00000100:00080000:2.0:1788666775.964142:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788666775.964147:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788666775.964152:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788666775.964619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666775.964625:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666775.964628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666775.964630:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788666775.964717:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666775.964731:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525056384:0@lo:400:kworker.0 00000400:00000100:1.0:1788666775.964775:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525056384 offset 0 length 224: 4 00010000:00010000:2.0:1788666775.965065:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666775.965078:0:21171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666775.965085:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666775.965092:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666775.965116:0:21171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666775.965123:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666775.965142:0:21171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666775.965148:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666775.965154:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666775.965173:0:21171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788666775.965178:0:21171:0:(mgc_request.c:545:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788666775.965206:0:21171:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788666775.965210:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788666775.965215:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666775.965233:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1788666775.965237:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:2.0:1788666775.965238:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff937072250000) has no exports 00010000:00010000:1.0:1788666775.965246:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666775.965256:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375ec00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666775.965260:0:17187:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788666775.965263:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff937072250000) has no exports 00010000:00010000:1.0:1788666775.965273:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666775.965282:0:17187:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666775.965288:0:17187:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788666775.965290:0:17187:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788666775.965293:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788666775.965313:0:17187:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9370446c8800 00010000:00010000:1.0:1788666775.965318:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666775.965334:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4375ec00/0x4267b949b564a4e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a4ef expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666775.965346:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666775.965350:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666775.965355:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666775.965358:0:17187:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666775.965364:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666775.965369:0:17187:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666775.965374:0:17187:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788666775.965376:0:17187:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788666775.965378:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788666775.965382:0:17187:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9370446c8800 00010000:00010000:1.0:1788666775.965385:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666775.965391:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff937040031200/0x4267b949b564a845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a84c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666775.965412:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666775.965414:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666775.965416:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666775.965506:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788666775.989661:0:21171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff936f431e9480 - data ffff937065c79288/ffff936f43ef5800 00000020:01000000:3.0:1788666775.989827:0:21171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937047f06300 - data ffff937065cab870/ffff93706dbc0800 00100000:10000000:3.0:1788666776.001117:0:21171:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788666776.010004:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a4fd 00000020:00000080:2.0:1788666776.010017:0:21171:0:(genops.c:885:class_export_put()) final put ffff936f43592800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788666776.010091:0:21171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937074bc9000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788666776.010095:0:21171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937074bc9000 2 00000020:01000004:2.0:1788666776.010098:0:21171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff937074bc9000 from lustre-OST0000 00000020:00000080:2.0:1788666776.010121:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666776.010130:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788666776.010133:0:21171:0:(genops.c:885:class_export_put()) final put ffff936f43597800/lustre-OST0000_UUID 00000020:00000080:2.0:1788666776.010135:0:21171:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43597800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788666776.010142:0:21171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788666776.010199:0:21171:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788666776.010204:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788666776.010208:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666776.010233:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788666776.010240:0:21171:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff936f42365800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788666776.010246:0:21171:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff936f42778000) has exports, disconnecting them 00000020:00080000:2.0:1788666776.010250:0:21171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff936f42365800), last request at 1788666700 00000020:00000080:2.0:1788666776.010254:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a527 00000020:00080000:2.0:1788666776.010264:0:21171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff936f42365800): rc 0 00000020:00000080:2.0:1788666776.010268:0:21171:0:(genops.c:885:class_export_put()) final put ffff936f42365800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788666776.014690:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43592800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788666776.018759:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f42365800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788666776.022900:0:21171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788666776.022921:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788666776.022925:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788666776.022933:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788666776.023110:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666776.023120:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788666776.023127:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788666776.023132:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666776.023136:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788666776.023143:0:21171:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff936f42367800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788666776.023150:0:21171:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9370722519c0) has exports, disconnecting them 00000020:00080000:0.0:1788666776.023154:0:21171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff936f42367800), last request at 1788666700 00000020:00000080:0.0:1788666776.023158:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a535 00000020:00080000:0.0:1788666776.023175:0:21171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff936f42367800): rc 0 00000020:00000080:0.0:1788666776.023180:0:21171:0:(genops.c:885:class_export_put()) final put ffff936f42367800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788666776.023803:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f42366000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788666776.023812:0:36:0:(genops.c:885:class_export_put()) final put ffff936f42360800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788666776.023815:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f42360800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788666776.023821:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788666776.023902:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f42367800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788666776.036462:0:21171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788666776.036470:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788666776.036474:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788666776.036480:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788666776.036673:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666776.036682:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788666776.036688:0:21171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937074bc9000 1 00000020:00000080:0.0:1788666776.036694:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a4da 00000020:00000080:0.0:1788666776.036703:0:21171:0:(genops.c:885:class_export_put()) final put ffff937042dfd000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788666776.036722:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f43594000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788666776.036727:0:36:0:(genops.c:885:class_export_put()) final put ffff936f43592000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788666776.036730:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43592000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788666776.036735:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:0.0:1788666776.036900:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788666776.036905:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666776.036909:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788666776.036912:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff93706f014d40) has no exports 00000020:00000080:1.0:1788666776.043975:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff937042dfd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788666776.065359:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666776.065373:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788666776.065379:0:21171:0:(genops.c:885:class_export_put()) final put ffff937074bcb800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788666776.065455:0:21171:0:(genops.c:844:class_export_destroy()) destroying export ffff937074bcb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788666776.065468:0:21171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788666776.065580:0:21171:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff937074bca800 00000020:02000400:0.0:1788666776.065625:0:21171:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788666776.476451:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666777.505961:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666778.524891:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788666779.315684:0:21373:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:3.0:1788666779.333007:0:21373:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788666779.333084:0:21373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666779.333110:0:21373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666779.333719:0:21373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666779.333726:0:21373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666779.333754:0:21373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788666779.333759:0:21373:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788666779.333783:0:21373:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788666779.333795:0:21373:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff937074ac5180 x1875552525055488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788666784 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666779.333918:0:21373:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788666779.333924:0:21373:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788666779.333930:0:21373:0:(import.c:65:import_set_state_nolock()) ffff936f4336a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788666779.333935:0:21373:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788666779.333940:0:21373:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff937074ac5180 x1875552525055488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788666784 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788666779.333953:0:18353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666779.333961:0:18353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666779.333969:0:18353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788666779.333973:0:18353:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666779.333983:0:18353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666779.334038:0:21373:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788666779.334054:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875552525055488:0@lo:38:kworker.0 10000000:00010000:0.0:1788666779.334069:0:18353:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666779.334077:0:18353:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788666779.334080:0:18353:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788666779.334083:0:18353:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788666779.334096:0:18353:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9370446c8800 00010000:00010000:0.0:1788666779.334100:0:18353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666779.334108:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a3a00/0x4267b949b564a670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a677 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666779.334133:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666779.334135:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666779.334137:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666779.334213:0:21373:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788666779.337813:0:21373:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788666779.337830:0:21373:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff937074ac5c00 x1875552525055616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666780 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666779.337988:0:21373:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff937074ac6a00 x1875552525055872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666781 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666779.338049:0:21373:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93707f600a80 x1875552525056000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666785 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666779.338070:0:21373:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93707f602680 x1875552525056256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666786 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666779.338085:0:21373:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff937074ac7b80 x1875552525056384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666791 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666779.338092:0:21373:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788666779.338097:0:21373:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788666779.338121:0:21373:0:(import.c:65:import_set_state_nolock()) ffff936f4213a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788666779.338260:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875552525055616:0@lo:400:kworker.0 00000100:00100000:0.0:1788666779.338439:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875552525056000:0@lo:400:kworker.0 00000100:00100000:0.0:1788666779.338493:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525056384:0@lo:400:kworker.0 00000100:00100000:0.0:1788666779.338508:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525056256:0@lo:400:kworker.0 00000100:00100000:0.0:1788666779.338547:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875552525056512:0@lo:39:umount.0 00000400:00000100:0.0:1788666779.338656:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552525056512 offset 0 length 224: 4 00000100:00100000:1.0:1788666779.339049:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875552525055872:0@lo:400:kworker.0 00010000:00010000:0.0:1788666779.549472:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666780.572338:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666781.084111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788666781.084120:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788666781.596053:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666782.621040:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666783.644199:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666784.668317:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666785.499959:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666770/real 1788666770] req@ffff93707f600e00 x1875552525056128/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788666785 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666785.499989:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93707f600e00 x1875552525056128/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788666785 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788666785.500008:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9370446c8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788666785.500031:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788666785.500036:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:09eda017-c07c-40fa-9b24-23f5903ec822:3637:1875552525056128:0@lo:250:kworker.0 00000100:00080000:2.0:1788666785.501291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 09eda017-c07c-40fa-9b24-23f5903ec822->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788666785.501299:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788666785.501302:0:36:0:(import.c:65:import_set_state_nolock()) ffff9370446c8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788666785.501307:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.134@tcp: connect to NID 0@lo last attempt 593 00000100:00080000:2.0:1788666785.501313:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.134@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788666785.501319:0:36:0:(import.c:665:import_select_connection()) MGC192.168.206.134@tcp: import ffff9370446c8800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:2.0:1788666785.501359:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43fe1c00 x1875552525056640/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666785.501461:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:09eda017-c07c-40fa-9b24-23f5903ec822:3637:1875552525056640:0@lo:250:kworker.0 00000400:00000100:1.0:1788666785.501572:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875552525056640 offset 0 length 520: 4 00010000:00010000:0.0:1788666785.693179:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666786.717095:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666787.742014:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666788.764043:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666789.596002:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666779/real 1788666779] req@ffff936f43fe2680 x1875552525056512/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788666789 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666789.596042:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff936f43fe2680 x1875552525056512/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788666789 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788666789.596059:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f4213a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788666789.596082:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875552525056512:0@lo:39:umount.0 00000100:00080000:2.0:1788666789.596226:0:21373:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788666789.596230:0:21373:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788666789.596236:0:21373:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788666789.598062:0:21373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666789.598079:0:21373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666789.598086:0:21373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666789.598093:0:21373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666789.598121:0:21373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666789.598128:0:21373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666789.598136:0:21373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666789.598142:0:21373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666789.598158:0:21373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666789.598196:0:21373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788666789.598201:0:21373:0:(mgc_request.c:545:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788666789.598222:0:21373:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788666789.598225:0:21373:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788666789.598230:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666789.598236:0:21373:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788666789.598240:0:21373:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9370510199c0) has no exports 00000020:00080000:2.0:1788666789.598261:0:21373:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9370510199c0) has no exports 00010000:00010000:1.0:1788666789.598821:0:18353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666789.598828:0:18353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666789.598865:0:18353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4451fa00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666789.598869:0:18353:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666789.598877:0:18353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666789.598883:0:18353:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666789.598889:0:18353:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788666789.598891:0:18353:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788666789.598893:0:18353:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788666789.598906:0:18353:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9370446c8800 00010000:00010000:1.0:1788666789.598910:0:18353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666789.598924:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4451fa00/0x4267b949b564a646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a64d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666789.598937:0:18353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666789.598941:0:18353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666789.598947:0:18353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040030200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666789.598949:0:18353:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666789.598956:0:18353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666789.598962:0:18353:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666789.598967:0:18353:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788666789.598969:0:18353:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788666789.598971:0:18353:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788666789.598977:0:18353:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9370446c8800 00010000:00010000:1.0:1788666789.598979:0:18353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666789.598986:0:18353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff937040030200/0x4267b949b564a837 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a83e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666789.598998:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666789.599000:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666789.599007:0:18353:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666789.600326:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788666789.607399:0:21373:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff937046dc8240 - data ffff937065f65d80/ffff936f43efe400 00000020:01000000:2.0:1788666789.607516:0:21373:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff936f43350a80 - data ffff936f41c10948/ffff93707bf43800 00100000:10000000:2.0:1788666789.619746:0:21373:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788666789.628485:0:21373:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a65b 00000020:00000080:3.0:1788666789.628496:0:21373:0:(genops.c:885:class_export_put()) final put ffff936f4336d000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788666789.628745:0:21373:0:(tgt_mount.c:187:server_put_mount()) put mount ffff936f42361800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788666789.628749:0:21373:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936f42361800 2 00000020:01000004:3.0:1788666789.628752:0:21373:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff936f42361800 from lustre-OST0001 00000020:00000080:3.0:1788666789.628775:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666789.628784:0:21373:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788666789.628796:0:21373:0:(genops.c:885:class_export_put()) final put ffff93704ded7000/lustre-OST0001_UUID 00000020:00000080:3.0:1788666789.628799:0:21373:0:(genops.c:844:class_export_destroy()) destroying export ffff93704ded7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788666789.628805:0:21373:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788666789.628915:0:21373:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 09eda017-c07c-40fa-9b24-23f5903ec822->MGS 00010000:00010000:3.0:1788666789.628929:0:21373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f4375fa00/0x4267b949b564a3a6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a3ad expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666789.628941:0:21373:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f4375fa00/0x4267b949b564a3a6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a3ad expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666789.628948:0:21373:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788666789.628951:0:21373:0:(mgc_request.c:952:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788666789.628953:0:21373:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788666789.628968:0:21373:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9370446c8800 00010000:00010000:3.0:1788666789.628972:0:21373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f4375fa00/0x4267b949b564a3a6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a3ad expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666789.628996:0:21373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff936f43339200/0x4267b949b564a295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4267b949b564a29c expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666789.629002:0:21373:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff936f43339200/0x4267b949b564a295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4267b949b564a29c expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666789.629007:0:21373:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788666789.629010:0:21373:0:(mgc_request.c:952:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788666789.629011:0:21373:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788666789.629020:0:21373:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9370446c8800 00010000:00010000:3.0:1788666789.629023:0:21373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff936f43339200/0x4267b949b564a295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4267b949b564a29c expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788666789.629038:0:21373:0:(import.c:65:import_set_state_nolock()) ffff9370446c8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788666789.629049:0:21373:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788666789.629051:0:21373:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788666789.629053:0:21373:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788666789.629056:0:21373:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788666789.629066:0:21373:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff936f43fe1c00 x1875552525056640/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788666805 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788666789.629082:0:21373:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788666789.629084:0:21373:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:1.0:1788666789.629174:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:09eda017-c07c-40fa-9b24-23f5903ec822:3637:1875552525056640:0@lo:250:kworker.0 10000000:01000000:3.0:1788666789.629310:0:21373:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788666789.629317:0:21373:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a280 00000020:00000080:3.0:1788666789.629322:0:21373:0:(genops.c:885:class_export_put()) final put ffff9370446c9800/09eda017-c07c-40fa-9b24-23f5903ec822 00000020:00000080:0.0:1788666789.629427:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4336d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788666789.629675:0:21373:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.134@tcp (flags='') 00000020:00000080:3.0:1788666789.629681:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666789.629686:0:21373:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.134@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788666789.629690:0:21373:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff936f43378000) has no exports 10000000:01000000:1.0:1788666789.629742:0:17196:0:(mgc_request.c:706:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1788666789.630139:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9370446c9800/09eda017-c07c-40fa-9b24-23f5903ec822 for MGC192.168.206.134@tcp 10000000:01000000:3.0:1788666789.630222:0:21373:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.134@tcp: client import never connected 00000100:00080000:3.0:1788666789.630226:0:21373:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788666789.630228:0:21373:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788666789.630230:0:21373:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788666789.630232:0:21373:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788666789.630342:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666789.630348:0:21373:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.134@tcp (uuid 09eda017-c07c-40fa-9b24-23f5903ec822) 00000020:01000000:3.0:1788666789.630352:0:21373:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788666789.630356:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666789.630359:0:21373:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788666789.630364:0:21373:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff936f4213d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788666789.630369:0:21373:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff936f420b4d40) has exports, disconnecting them 00000020:00080000:3.0:1788666789.630373:0:21373:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff936f4213d800), last request at 1788666713 00000020:00000080:3.0:1788666789.630377:0:21373:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a685 00000020:00080000:3.0:1788666789.630389:0:21373:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff936f4213d800): rc 0 00000020:00000080:3.0:1788666789.630392:0:21373:0:(genops.c:885:class_export_put()) final put ffff936f4213d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788666789.632966:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9370446c8800 for MGC192.168.206.134@tcp 00000020:00000080:0.0:1788666789.632992:0:37:0:(genops.c:885:class_export_put()) final put ffff936f43f76800/09eda017-c07c-40fa-9b24-23f5903ec822 00000020:00000080:0.0:1788666789.632996:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43f76800/09eda017-c07c-40fa-9b24-23f5903ec822 for MGC192.168.206.134@tcp 00000020:01000000:0.0:1788666789.633003:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.134@tcp (09eda017-c07c-40fa-9b24-23f5903ec822) 00000020:00000080:0.0:1788666789.633268:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4213d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788666789.639534:0:21373:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788666789.639542:0:21373:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788666789.639547:0:21373:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788666789.639553:0:21373:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788666789.639755:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666789.639764:0:21373:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788666789.639770:0:21373:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788666789.639776:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666789.639780:0:21373:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788666789.639787:0:21373:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff936f42139000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788666789.639794:0:21373:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff93707b510000) has exports, disconnecting them 00000020:00080000:0.0:1788666789.639798:0:21373:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff936f42139000), last request at 1788666713 00000020:00000080:0.0:1788666789.639802:0:21373:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a69a 00000020:00080000:0.0:1788666789.639817:0:21373:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff936f42139000): rc 0 00000020:00000080:0.0:1788666789.639822:0:21373:0:(genops.c:885:class_export_put()) final put ffff936f42139000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788666789.639932:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f4336a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788666789.639938:0:37:0:(genops.c:885:class_export_put()) final put ffff936f4336b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788666789.639941:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f4336b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788666789.639950:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788666789.640859:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f42139000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788666789.640879:0:21373:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788666789.640882:0:21373:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788666789.640885:0:21373:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788666789.640889:0:21373:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788666789.640902:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff936f4213a800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788666789.640939:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788666789.641061:0:18353:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788666789.641120:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788666789.641211:0:17183:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93704808a600:17183] 1 exiting: rc = 0 00000100:00100000:3.0:1788666789.641391:0:17182:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff937047f08800:17182] 0 exiting: rc = 1 00000100:00100000:1.0:1788666789.641647:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.641863:0:17184:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff936f43106c00:17184] 0 exiting: rc = 1 00000100:00100000:3.0:1788666789.642029:0:20224:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff936f43293a00:20224] 3 exiting: rc = 0 00000100:00100000:3.0:1788666789.642096:0:17186:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff937074add800:17186] 2 exiting: rc = 0 00000100:00100000:3.0:1788666789.642143:0:17185:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff937074adca00:17185] 1 exiting: rc = 0 00000100:00100000:1.0:1788666789.642273:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642280:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642286:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642291:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642297:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642306:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642311:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642316:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642320:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642325:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642330:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642346:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642352:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642358:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642363:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642368:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642372:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642377:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642382:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642386:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642391:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642396:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642401:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642406:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642411:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642416:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642421:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642427:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642431:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642436:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642440:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642445:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642450:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642456:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642461:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642465:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642470:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642474:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642479:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642483:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642488:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642492:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642497:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642502:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642507:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642511:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642526:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642531:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642536:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642541:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642546:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642550:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642555:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642560:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642565:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642570:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642575:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642580:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642585:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642590:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642594:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642599:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642604:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666789.642609:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788666789.643268:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788666789.643277:0:21373:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788666789.643282:0:21373:0:(genops.c:885:class_export_put()) final put ffff936f42138000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788666789.643285:0:21373:0:(genops.c:844:class_export_destroy()) destroying export ffff936f42138000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788666789.643290:0:21373:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788666789.643336:0:21373:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936f42361800 1 00000020:00000080:1.0:1788666789.643341:0:21373:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4267b949b564a63f 00000020:00000080:1.0:1788666789.643347:0:21373:0:(genops.c:885:class_export_put()) final put ffff936f43596800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788666789.643357:0:21373:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788666789.643366:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff936f43596800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788666789.643375:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788666789.643380:0:21373:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788666789.643384:0:21373:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff936f4277b380) has no exports 00000020:00000080:1.0:1788666789.755601:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788666789.755613:0:21373:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788666789.755625:0:21373:0:(genops.c:885:class_export_put()) final put ffff936f42365000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788666789.755629:0:21373:0:(genops.c:844:class_export_destroy()) destroying export ffff936f42365000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788666789.755640:0:21373:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788666789.755956:0:21373:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff936f42364000 00000020:01000000:1.0:1788666789.755973:0:21373:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788666789.755977:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788666789.755982:0:21373:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788666789.755986:0:21373:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff937066b519c0) has no exports 00000020:00000080:1.0:1788666789.756003:0:21373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788666789.756008:0:21373:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788666789.756011:0:21373:0:(genops.c:885:class_export_put()) final put ffff937042dff800/OSS_uuid 00000020:00000080:1.0:1788666789.756013:0:21373:0:(genops.c:844:class_export_destroy()) destroying export ffff937042dff800/OSS_uuid for OSS 00000020:01000000:1.0:1788666789.756016:0:21373:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788666789.756041:0:17195:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788666789.756190:0:18704:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff936f43c32600:18704] 0 exiting: rc = 1 00000100:00100000:1.0:1788666789.756234:0:18705:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93707b7ed400:18705] 1 exiting: rc = 0 00000100:00100000:1.0:1788666789.758949:0:19089:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff936f42668200:19089] 3 exiting: rc = 0 00000100:00100000:0.0:1788666789.758956:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93707b7ede00:18706] 2 exiting: rc = 0 00000100:00100000:3.0:1788666789.759084:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759096:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759103:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759111:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759119:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759126:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759131:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759137:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759158:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759164:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759169:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759174:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759180:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759373:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759380:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759385:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759390:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759396:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759400:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759405:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759410:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759415:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759419:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759424:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759429:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759434:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759440:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759451:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759525:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759534:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759552:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759564:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759570:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759576:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759588:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759599:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759605:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759611:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759615:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759621:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759626:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759631:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759636:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759641:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759646:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759651:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759657:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759662:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759671:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759678:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759684:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759690:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759715:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759722:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759727:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759732:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759737:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759742:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759746:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759751:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759755:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759760:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759764:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.759769:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761116:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93707b7ece00:18709] 1 exiting: rc = 0 00000100:00100000:3.0:1788666789.761362:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93707b7ec200:18708] 0 exiting: rc = 1 00000100:00100000:3.0:1788666789.761415:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761421:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761427:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761432:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761438:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761443:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761448:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761452:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761457:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761462:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761466:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761470:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761475:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761480:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761485:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761490:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761495:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761500:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761505:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761510:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761516:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761521:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761525:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761530:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761535:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761539:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761544:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761549:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761555:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761560:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761565:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761570:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761576:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761581:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761594:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761599:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761604:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761610:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761615:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761620:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761625:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761630:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761635:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761640:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761646:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761651:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761656:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761662:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761667:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761672:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761679:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761684:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761695:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761702:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761708:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761713:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761719:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761724:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761729:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761734:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761739:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761744:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761749:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.761754:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.762972:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93707606ca00:18712] 2 exiting: rc = 0 00000100:00100000:3.0:1788666789.764502:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93707be85c00:18710] 0 exiting: rc = 1 00000100:00100000:1.0:1788666789.767433:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93707606d600:18711] 1 exiting: rc = 0 00000100:00100000:3.0:1788666789.768094:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768104:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768110:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768128:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768134:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768140:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768156:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768163:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768169:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768174:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768180:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768196:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768210:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768237:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768245:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768252:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768258:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768263:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768268:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768274:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768280:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768285:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768291:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768297:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768303:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768308:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768314:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768319:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768325:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768331:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768337:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768343:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768348:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768353:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768359:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768364:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768370:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768392:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768405:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768410:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768416:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768421:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768426:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768431:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768437:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768443:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768448:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768456:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768462:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768467:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768474:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768480:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768486:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768492:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768497:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768502:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768507:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768512:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768517:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768522:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768527:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768543:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768549:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.768564:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.786908:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93707bf24800:18713] 0 exiting: rc = 1 00000100:00100000:3.0:1788666789.787007:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93707606d200:18714] 1 exiting: rc = 0 00000100:00100000:0.0:1788666789.787111:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787118:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787122:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787127:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787132:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787138:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787143:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787159:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787164:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787182:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787187:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787191:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787196:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787212:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787217:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787222:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787227:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787232:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787237:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787242:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787247:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787252:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787257:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787263:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787270:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787275:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787280:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787286:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787291:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787296:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787301:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787306:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787312:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787316:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787321:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787332:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787340:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787346:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787350:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787355:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787360:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787365:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787370:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787375:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787387:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787393:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787398:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787403:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787408:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787414:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787419:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787424:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787429:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787435:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787440:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787445:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787450:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787455:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787460:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787466:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787471:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787476:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787481:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.787487:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666789.788242:0:18715:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93707bf24000:18715] 0 exiting: rc = 1 00000100:00100000:3.0:1788666789.788316:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93707bf25c00:18716] 1 exiting: rc = 0 00000100:00100000:0.0:1788666789.788794:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788801:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788806:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788812:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788817:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788822:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788829:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788906:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788914:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788922:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788928:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788934:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788959:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788970:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788975:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788990:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.788996:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789002:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789007:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789013:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789018:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789024:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789029:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789034:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789058:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789066:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789073:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789081:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789087:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789092:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789098:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789104:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789109:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789115:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789120:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789126:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789158:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789165:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789171:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789177:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789182:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789188:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789194:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789258:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789267:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789274:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789287:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789293:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789318:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789324:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789337:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789343:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789350:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789356:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789362:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789368:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789375:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789385:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789393:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789398:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789420:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789428:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789434:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666789.789441:0:21373:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788666789.803065:0:21373:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788666805.890136:0:22137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg634-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788666814.901578:0:22737:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:3.0:1788666814.901584:0:22737:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788666814.901586:0:22737:0:(obd_mount.c:927:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788666814.904855:0:22737:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff937065bbb800 00000020:01000004:3.0:1788666814.904877:0:22737:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788666814.904898:0:22737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788666814.904913:0:22737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff936f4277cd40) 00000020:00000080:3.0:1788666814.904927:0:22737:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788666815.039318:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788666815.041086:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788666815.041698:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788666815.042294:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788666815.042558:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788666815.043067:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788666815.043287:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788666815.043756:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788666815.044327:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788666815.044678:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788666815.045054:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788666815.045313:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788666815.045640:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788666815.046077:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788666815.048604:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788666815.055646:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.056118:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.056343:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.056696:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.057059:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.057517:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.057742:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.058167:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.058654:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.059052:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.059381:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.059713:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.060090:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.060358:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.060685:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.061103:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.061809:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.062455:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.062939:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.063520:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.063863:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.064271:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.064587:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.064790:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.065131:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.065522:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.065786:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.066304:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.066711:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.066981:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788666815.067310:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.067641:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788666815.069155:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788666815.070221:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788666815.070788:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788666815.071692:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788666815.071973:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788666815.080798:0:22737:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788666815.083416:0:22737:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788666815.083700:0:22737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788666815.083712:0:22737:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788666815.083724:0:22737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4267b949b564aaf3 00000020:01000004:3.0:1788666815.083730:0:22737:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788666815.083735:0:22737:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788666815.083738:0:22737:0:(tgt_mount.c:101:server_register_mount()) register mount ffff937065bbb800 from MGS 00000020:01000004:3.0:1788666815.083742:0:22737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788666815.083752:0:22737:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff936f427799c0) 00000020:00000080:3.0:1788666815.085487:0:22737:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788666815.085569:0:22737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937065bbb800 from MGS, refs=2 00080000:01000000:3.0:1788666815.085576:0:22737:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788666815.085584:0:22737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4267b949b564ab01 00000100:00100000:3.0:1788666815.085709:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788666815.085865:0:22737:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788666815.085877:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788666815.087518:0:22737:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788666815.087529:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788666815.088611:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666815.088773:0:22737:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788666815.088779:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788666815.089732:0:22737:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788666815.089741:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788666815.090244:0:22737:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788666815.090259:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788666815.091280:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666815.091284:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666815.091285:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666815.092233:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666815.092237:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666815.092238:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666815.092721:0:22737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788666815.094389:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788666815.099137:0:22737:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788666815.101040:0:22749:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788666815.101066:0:22737:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788666815.101124:0:22737:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788666815.102993:0:22737:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788666815.104798:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666815.105045:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788666815.105053:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788666815.109593:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788666815.109783:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788666815.111546:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788666815.111563:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788666815.115513:0:22737:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788666815.115535:0:22737:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.134@tcp' 00000020:01000004:2.0:1788666815.115537:0:22737:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788666815.115564:0:22737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.134@tcp (typ=mgc) 00000020:00000080:2.0:1788666815.115577:0:22737:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.134@tcp (ffff937072250000) 00000020:00000080:2.0:1788666815.115592:0:22737:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788666815.115671:0:22737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93707bfc7800@MGC192.168.206.134@tcp: add connection 192.168.206.134@tcp at head 00010000:00010000:2.0:1788666815.115822:0:22737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.134@tcp-0 is initialized 00000040:01000000:2.0:1788666815.115828:0:22737:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.134@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788666815.118692:0:22754:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788666815.118723:0:22756:0:(mgc_request.c:629:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788666815.118821:0:22737:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.134@tcp (uuid a62c9863-c7b0-471d-812b-42670ca06572) 00000020:00000080:2.0:1788666815.119136:0:22737:0:(genops.c:1385:class_connect()) connect: client a62c9863-c7b0-471d-812b-42670ca06572, cookie 0x4267b949b564ab0f 00000100:00080000:2.0:1788666815.119150:0:22737:0:(import.c:545:import_select_connection()) MGC192.168.206.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788666815.119157:0:22737:0:(import.c:665:import_select_connection()) MGC192.168.206.134@tcp: import ffff93707bfc7800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:2.0:1788666815.119261:0:22737:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43fe3800 x1875552525056768/t0(0) o250->MGC192.168.206.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788666815.119363:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a62c9863-c7b0-471d-812b-42670ca06572:3637:1875552525056768:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788666815.119441:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788666815.119664:0:22737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a62c9863-c7b0-471d-812b-42670ca06572->MGS 00000020:01000004:2.0:1788666815.119691:0:22737:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788666815.119697:0:22737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788666815.119711:0:22737:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff937072254d40) 00000020:00000080:2.0:1788666815.119725:0:22737:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788666815.133698:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525056768 00000100:00100000:0.0:1788666815.133712:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525056768 00000100:00100000:0.0:1788666815.133766:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666815.133776:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1875552525056768:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788666815.133806:0:22751:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a62c9863-c7b0-471d-812b-42670ca06572@0@lo t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:0.0:1788666815.133870:0:22751:0:(genops.c:1385:class_connect()) connect: client a62c9863-c7b0-471d-812b-42670ca06572, cookie 0x4267b949b564ab1d 00000100:00080000:0.0:1788666815.134032:0:22751:0:(import.c:65:import_set_state_nolock()) ffff937047d0d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788666815.134124:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+5:3637:x1875552525056768:12345-0@lo:250:mount.lustre.0 Request processed in 348us (14681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666815.134143:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666815.134202:0:3637:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788666815.134212:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.134@tcp: connect to target with instance 0 00000100:00080000:0.0:1788666815.134219:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788666815.134223:0:3637:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788666815.134227:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93707bfc7800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788666815.134229:0:3637:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788666815.134239:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788666815.134245:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a62c9863-c7b0-471d-812b-42670ca06572:3637:1875552525056768:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788666815.139355:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666815.141005:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788666815.141024:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788666815.142139:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788666815.142147:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788666815.142750:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788666815.142759:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788666815.146530:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666815.146770:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788666815.146778:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788666815.149076:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788666815.149091:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788666815.195410:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666815.195784:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788666815.195790:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788666815.198235:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788666815.198249:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788666815.200374:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666815.200733:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788666815.200738:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788666815.201389:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788666815.201396:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788666815.204951:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666815.211236:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788666815.211245:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788666815.213997:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788666815.214021:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788666815.215881:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666815.216067:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788666815.216073:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788666815.217368:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788666815.217378:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788666815.239406:0:22737:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666815.239726:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788666815.239733:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788666815.241049:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788666815.241061:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788666815.241723:0:22737:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788666815.241731:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788666815.242774:0:22737:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788666815.242801:0:22737:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788666815.242807:0:22737:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788666815.243111:0:22737:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788666815.243144:0:22737:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.134@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788666815.243148:0:22737:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788666815.243150:0:22737:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788666815.243151:0:22737:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666815.243152:0:22737:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666815.243153:0:22737:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666815.243154:0:22737:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666815.243155:0:22737:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788666815.243157:0:22737:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788666815.243158:0:22737:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666815.243159:0:22737:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788666815.243162:0:22737:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788666815.243164:0:22737:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788666815.243165:0:22737:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788666815.243166:0:22737:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666815.243167:0:22737:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666815.243168:0:22737:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666815.243169:0:22737:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666815.243170:0:22737:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788666815.243171:0:22737:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788666815.243172:0:22737:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666815.243173:0:22737:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788666815.243198:0:22737:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788666815.243215:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525056896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788666815.243286:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666815.243363:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704390a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666815.243408:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525056896 00000100:00100000:0.0:1788666815.243416:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525056896 00000100:00100000:0.0:1788666815.243497:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788666815.243506:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+5:22737:x1875552525056896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788666815.243552:0:22753:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788666815.243555:0:22753:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788666815.243557:0:22753:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788666815.244047:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788666815.244679:0:22753:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788666815.246088:0:22775:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788666815.246094:0:22775:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788666815.246104:0:22775:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788666815.246107:0:22775:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788666815.246283:0:22775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788666815.246543:0:22753:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788666815.246552:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788666815.248537:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+5:22737:x1875552525056896:12345-0@lo:253:mount.lustre.0 Request processed in 5023us (5242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666815.248551:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666815.248930:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525056896:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788666815.248956:0:22737:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788666815.248959:0:22737:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788666815.248961:0:22737:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788666815.248963:0:22737:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666815.248964:0:22737:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666815.248965:0:22737:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666815.248967:0:22737:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666815.248969:0:22737:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788666815.248970:0:22737:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788666815.248972:0:22737:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666815.248973:0:22737:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788666815.248991:0:22737:0:(tgt_mount.c:101:server_register_mount()) register mount ffff937065bbb800 from lustre-MDT0000 10000000:01000000:2.0:1788666815.249031:0:22737:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788666815.249034:0:22737:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788666815.249038:0:22737:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff937072250000 10000000:01000000:2.0:1788666815.249042:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788666815.249050:0:22737:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff937072250000 from 1 10000000:01000000:2.0:1788666815.249053:0:22737:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788666815.249087:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.249097:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.249107:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666815.249126:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666815.249161:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666815.249261:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704390a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788666815.249296:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525057024 00000100:00100000:0.0:1788666815.249302:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525057024 00000100:00100000:0.0:1788666815.249366:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788666815.249374:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+5:22737:x1875552525057024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666815.249385:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666815.249398:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937082044400/0x4267b949b564ab2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ab24 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.249426:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937082044400/0x4267b949b564ab2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ab24 expref: 6 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.249437:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937082044400/0x4267b949b564ab2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ab24 expref: 6 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.249445:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937082044400, rc 0) 00000100:00100000:0.0:1788666815.249530:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+6:22737:x1875552525057024:12345-0@lo:101:mount.lustre.0 Request processed in 157us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666815.249537:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788666815.249767:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666815.249781:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.249791:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.249872:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666815.249900:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.249919:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937047d2ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.249973:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525057152 00000100:00100000:2.0:1788666815.249978:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525057152 00000100:00100000:2.0:1788666815.250008:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666815.250031:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+6:22737:x1875552525057152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666815.250094:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+6:22737:x1875552525057152:12345-0@lo:501:mount.lustre.0 Request processed in 64us (192us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666815.250101:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666815.250165:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057152:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788666815.250190:0:22737:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788666815.250209:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.250218:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666815.250226:0:22737:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff937065bbb800 10000000:01000000:3.0:1788666815.250230:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788666815.250234:0:22737:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff937065bbb800 10000000:01000000:3.0:1788666815.250237:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788666815.250240:0:22737:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff937065bbb800 from 1 10000000:01000000:3.0:1788666815.250242:0:22737:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788666815.250260:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f9800/0x4267b949b564ab32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.250277:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370582f9800/0x4267b949b564ab32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.250286:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370582f9800/0x4267b949b564ab32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.250298:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666815.250323:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.250333:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937047d2ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.250380:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525057280 00000100:00100000:2.0:1788666815.250384:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525057280 00000100:00100000:2.0:1788666815.250410:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666815.250416:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+6:22737:x1875552525057280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666815.250424:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666815.250435:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a3e00/0x4267b949b564ab39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ab32 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.250449:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a3e00/0x4267b949b564ab39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ab32 expref: 7 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.250701:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a3e00/0x4267b949b564ab39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ab32 expref: 7 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.250710:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a3e00, rc 0) 00000100:00100000:2.0:1788666815.250738:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+7:22737:x1875552525057280:12345-0@lo:101:mount.lustre.0 Request processed in 322us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.250744:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788666815.250808:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666815.250819:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370582f9800/0x4267b949b564ab32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab39 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.250828:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370582f9800/0x4267b949b564ab32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ab39 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666815.250869:0:22737:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788666815.250878:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f9800/0x4267b949b564ab32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab39 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.250885:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370582f9800/0x4267b949b564ab32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab39 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666815.250891:0:22737:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788666815.250895:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788666815.250900:0:22737:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff937065bbb800 10000000:01000000:3.0:1788666815.250902:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788666815.250910:0:22737:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788666815.250912:0:22737:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788666815.250928:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f8400/0x4267b949b564ab40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.250936:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370582f8400/0x4267b949b564ab40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.250943:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370582f8400/0x4267b949b564ab40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.250956:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666815.250980:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.250992:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937047d2ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.251052:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525057408 00000100:00100000:2.0:1788666815.251057:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525057408 00000100:00100000:2.0:1788666815.251084:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666815.251091:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+7:22737:x1875552525057408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666815.251098:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666815.251107:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a2e00/0x4267b949b564ab47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ab40 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.251128:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a2e00/0x4267b949b564ab47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ab40 expref: 8 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.251137:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a2e00/0x4267b949b564ab47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ab40 expref: 8 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.251144:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a2e00, rc 0) 00000100:00100000:2.0:1788666815.251169:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+8:22737:x1875552525057408:12345-0@lo:101:mount.lustre.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.251176:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666815.251237:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666815.251247:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370582f8400/0x4267b949b564ab40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab47 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.251254:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370582f8400/0x4267b949b564ab40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ab47 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.251295:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666815.251318:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.251384:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937047d2ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.251724:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525057536 00000100:00100000:2.0:1788666815.251729:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525057536 00000100:00100000:2.0:1788666815.251788:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666815.251796:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+8:22737:x1875552525057536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666815.251996:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+9:22737:x1875552525057536:12345-0@lo:501:mount.lustre.0 Request processed in 200us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.252003:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788666815.252132:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666815.252164:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666815.252204:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666815.252268:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704351a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.252311:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525057664 00000100:00100000:2.0:1788666815.252315:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525057664 00000100:00100000:2.0:1788666815.252369:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666815.252376:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+9:22737:x1875552525057664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666815.253187:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+9:22737:x1875552525057664:12345-0@lo:503:mount.lustre.0 Request processed in 809us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.253196:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666815.253278:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525057664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666815.254045:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22776:1875552525057792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666815.254093:0:22776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666815.254169:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704390a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788666815.254210:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525057792 00000100:00100000:3.0:1788666815.254216:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525057792 00000100:00100000:3.0:1788666815.254282:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788666815.254291:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+9:22776:x1875552525057792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666815.255065:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+9:22776:x1875552525057792:12345-0@lo:502:llog_process_th.0 Request processed in 772us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666815.255080:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788666815.255169:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22776:1875552525057792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666815.255196:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666815.255207:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.255210:0:22776:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788666815.255214:0:22776:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788666815.255217:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666815.255231:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff936f420b4d40) 00000020:00000080:1.0:1788666815.255247:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788666815.255252:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788666815.255330:0:22776:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788666815.255337:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4267b949b564ab55 00000020:00000080:1.0:1788666815.255550:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788666815.255554:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666815.255558:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.255559:0:22776:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788666815.255562:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666815.255576:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.255578:0:22776:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788666815.255582:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666815.255588:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff936f420b19c0) 00000020:00000080:1.0:1788666815.255597:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788666815.255608:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788666815.255610:0:22776:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788666815.255612:0:22776:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788666815.255618:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788666815.255681:0:22776:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937065bbb800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788666815.255693:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff936f420b0000) 00000020:00000080:1.0:1788666815.255701:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788666815.255748:0:22776:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788666815.255753:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4267b949b564ab6a 00000020:00000080:1.0:1788666815.255875:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788666815.255881:0:22776:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788666815.255886:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4267b949b564ab71 00080000:01000000:1.0:1788666815.255890:0:22776:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788666815.255893:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4267b949b564ab78 00010000:00010000:2.0:1788666815.346343:0:22776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788666815.348008:0:22776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1788666815.348325:0:22776:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788666815.349405:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff936f4277b380) 00000020:00000080:3.0:1788666815.349424:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788666815.349523:0:22776:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788666815.349531:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4267b949b564ab86 00000020:00000080:2.0:1788666815.350234:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788666815.359107:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4267b949b564ab8d 00000020:00000080:3.0:1788666815.359894:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788666815.359906:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666815.359913:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.359915:0:22776:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788666815.359918:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788666815.359921:0:22776:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788666815.359923:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788666815.359924:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788666815.359926:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788666815.359928:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.359930:0:22776:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788666815.359932:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666815.359937:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.359939:0:22776:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788666815.359943:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788666815.359981:0:22776:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788666815.359997:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666815.360001:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.360002:0:22776:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788666815.360005:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666815.360008:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.360009:0:22776:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788666815.360025:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788666815.360031:0:22776:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.134@tcp to nid 0x20000c0a8ce86 (192.168.206.134@tcp) 00000020:00000080:3.0:1788666815.360056:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788666815.360071:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff936f42778000) 00000020:00000080:3.0:1788666815.360095:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788666815.360100:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788666815.360155:0:22776:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788666815.360161:0:22776:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788666815.360167:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4267b949b564ab9b 00010000:00080000:3.0:1788666815.360196:0:22776:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937044125000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.134@tcp at head 00010000:00010000:3.0:1788666815.363136:0:22776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788666815.367179:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788666815.367194:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788666815.367233:0:22776:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788666815.367253:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4267b949b564aba2 00000100:00080000:2.0:1788666815.367263:0:22776:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788666815.367269:0:22776:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937044125000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:2.0:1788666815.367303:0:22776:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43fe1500 x1875552525057920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788666815.367329:0:22776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788666815.367392:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666815.367396:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666815.367398:0:22776:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788666815.367401:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788666815.367403:0:22776:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788666815.367405:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788666815.367407:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788666815.367408:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788666815.367411:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666815.367412:0:22776:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788666815.367415:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788666815.367419:0:22776:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788666815.367422:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666815.367424:0:22776:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788666815.367427:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788666815.367431:0:22776:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.134@tcp to nid 0x20000c0a8ce86 (192.168.206.134@tcp) 00000020:01000000:2.0:1788666815.367465:0:22776:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788666815.367477:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788666815.367489:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff937072253380) 00000020:00000080:2.0:1788666815.367500:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788666815.367505:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788666815.367577:0:22776:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788666815.367583:0:22776:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788666815.367591:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4267b949b564abb0 00010000:00080000:2.0:1788666815.367620:0:22776:0:(ldlm_lib.c:102:import_set_conn()) imp ffff936f43c77800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.134@tcp at head 00010000:00010000:2.0:1788666815.367941:0:22776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788666815.369292:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525057920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788666815.369367:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666815.370214:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525057920 00000100:00100000:1.0:1788666815.370223:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525057920 00000100:00100000:1.0:1788666815.370259:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666815.370266:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875552525057920:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788666815.370284:0:22763:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788666815.371964:0:22776:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788666815.372368:0:22776:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788666815.381979:0:22776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666815.383449:0:22776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:1.0:1788666815.394083:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875552525057920:12345-0@lo:38:llog_process_th.0 Request processed in 23808us (24708us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788666815.394096:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788666815.394190:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666815.394196:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788666815.394201:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525057920:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788666815.397265:0:22776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788666815.398139:0:22782:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788666815.398145:0:22782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788666815.404272:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788666815.404287:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788666815.404335:0:22776:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788666815.404353:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4267b949b564abb7 00000100:00080000:1.0:1788666815.404362:0:22776:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788666815.404368:0:22776:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff936f43c77800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666815.404403:0:22776:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac6a00 x1875552525058048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788666815.404486:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525058048:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788666815.404544:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525058048 offset 0 length 520: 4 00000100:00080000:1.0:1788666815.404677:0:22776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788666815.404740:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666815.404744:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.404746:0:22776:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788666815.404749:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788666815.404752:0:22776:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788666815.404753:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788666815.404755:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788666815.404756:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788666815.404758:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.404760:0:22776:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788666815.404762:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788666815.404766:0:22776:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788666815.404769:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.404771:0:22776:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788666815.404774:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788666815.404777:0:22776:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.134@tcp to nid 0x20000c0a8ce86 (192.168.206.134@tcp) 00000020:01000000:1.0:1788666815.404797:0:22776:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788666815.404800:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666815.404811:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff936f420b3380) 00000020:00000080:1.0:1788666815.404823:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788666815.404828:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788666815.404921:0:22776:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788666815.404928:0:22776:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788666815.404934:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4267b949b564abc5 00010000:00080000:1.0:1788666815.404962:0:22776:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9370523ca800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.134@tcp at head 00010000:00010000:1.0:1788666815.405174:0:22776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788666815.405239:0:22776:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788666815.405255:0:22776:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788666815.407318:0:22776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666815.407658:0:22776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788666815.407853:0:22776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788666815.408412:0:22784:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788666815.408419:0:22784:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788666815.409763:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788666815.409781:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788666815.410234:0:22776:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788666815.410269:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4267b949b564abcc 00000100:00080000:1.0:1788666815.410284:0:22776:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788666815.410292:0:22776:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9370523ca800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666815.410341:0:22776:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac5180 x1875552525058176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666815.410372:0:22776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788666815.410507:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666815.410513:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.410515:0:22776:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788666815.410520:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666815.410525:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.410528:0:22776:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788666815.410531:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788666815.410533:0:22776:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788666815.410537:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666815.410540:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.410541:0:22776:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788666815.410543:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666815.410546:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.410548:0:22776:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788666815.410552:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788666815.410594:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22776:1875552525058304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666815.410619:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525058176:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788666815.410729:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525058176 offset 0 length 520: 4 00000100:00100000:1.0:1788666815.411208:0:22776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666815.411268:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074aadb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788666815.411365:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525058304 00000100:00100000:3.0:1788666815.411375:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525058304 00000100:00100000:3.0:1788666815.411427:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788666815.411439:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+9:22776:x1875552525058304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666815.411751:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+9:22776:x1875552525058304:12345-0@lo:502:llog_process_th.0 Request processed in 313us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666815.411759:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788666815.411929:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22776:1875552525058304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666815.411970:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666815.411977:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666815.411980:0:22776:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788666815.411984:0:22776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788666815.412227:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788666815.412256:0:22737:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788666815.412276:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f8400/0x4267b949b564ab40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab47 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.412291:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370582f8400/0x4267b949b564ab40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab47 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666815.412300:0:22737:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff937065bbb800 from 1 10000000:01000000:3.0:1788666815.412303:0:22737:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788666815.412343:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.412352:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.412374:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.412396:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666815.412444:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.412747:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265780 going to sleep for 11 seconds 00000100:00100000:3.0:1788666815.412775:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525058432 00000100:00100000:3.0:1788666815.412782:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525058432 00000100:00100000:3.0:1788666815.412974:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788666815.412985:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+9:22737:x1875552525058432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666815.413000:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666815.413030:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564abd3 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.413057:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564abd3 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.413069:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564abd3 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.413078:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f9c00, rc 0) 00000100:00100000:3.0:1788666815.413122:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+10:22737:x1875552525058432:12345-0@lo:101:mount.lustre.0 Request processed in 139us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666815.413129:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788666815.413320:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666815.413337:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.413359:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.415975:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058560:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788666815.416081:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.416192:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265780 going to sleep for 11 seconds 00000100:00100000:1.0:1788666815.416303:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525058560 00000100:00100000:1.0:1788666815.416313:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525058560 00000100:00100000:1.0:1788666815.416418:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666815.416430:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+10:22737:x1875552525058560:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788666815.417380:0:22753:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788666815.417395:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788666815.422454:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+10:22737:x1875552525058560:12345-0@lo:256:mount.lustre.0 Request processed in 6016us (6363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666815.422468:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788666815.423035:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058560:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788666815.423625:0:22737:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788666815.423648:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.423659:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666815.423667:0:22737:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff937065bbb800 from 1 10000000:01000000:3.0:1788666815.423670:0:22737:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788666815.423710:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.423719:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.423728:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.423748:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666815.423792:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.423883:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265780 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.424025:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525058688 00000100:00100000:2.0:1788666815.424040:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525058688 00000100:00100000:2.0:1788666815.424121:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666815.424133:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+10:22737:x1875552525058688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666815.424165:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666815.424185:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564abe1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.424238:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564abe1 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.424251:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564abe1 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.424261:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a2a00, rc 0) 00000100:00100000:2.0:1788666815.424334:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+11:22737:x1875552525058688:12345-0@lo:101:mount.lustre.0 Request processed in 204us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.424341:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788666815.426131:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666815.426160:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.426173:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.426255:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666815.426310:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.426438:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265780 going to sleep for 11 seconds 00000100:00100000:1.0:1788666815.430139:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525058816 00000100:00100000:1.0:1788666815.430154:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525058816 00000100:00100000:1.0:1788666815.430265:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666815.430275:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+11:22737:x1875552525058816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666815.430464:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+11:22737:x1875552525058816:12345-0@lo:501:mount.lustre.0 Request processed in 190us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666815.430482:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788666815.430587:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666815.430634:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666815.430688:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.433509:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265780 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.433728:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525058944 00000100:00100000:2.0:1788666815.433737:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525058944 00000100:00100000:2.0:1788666815.434080:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788666815.434090:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+11:22737:x1875552525058944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666815.434341:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+11:22737:x1875552525058944:12345-0@lo:503:mount.lustre.0 Request processed in 252us (3652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.434349:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788666815.434757:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525058944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666815.435276:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22786:1875552525059072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666815.435327:0:22786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.435368:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370512659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.435710:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525059072 00000100:00100000:2.0:1788666815.435717:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525059072 00000100:00100000:2.0:1788666815.435758:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788666815.435766:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+11:22786:x1875552525059072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666815.436295:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+11:22786:x1875552525059072:12345-0@lo:502:llog_process_th.0 Request processed in 528us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.436303:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666815.436405:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22786:1875552525059072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788666815.436435:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666815.436445:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.436448:0:22786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788666815.436575:0:22786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff937065bbb800 00000020:00000080:3.0:1788666815.436581:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666815.436590:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666815.436599:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.436600:0:22786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788666815.436603:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666815.436606:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.436607:0:22786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788666815.436611:0:22786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff937065bbb800 00000020:00000080:3.0:1788666815.436614:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666815.436777:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666815.436782:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.436783:0:22786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788666815.436786:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666815.436789:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.436790:0:22786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788666815.436794:0:22786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff937065bbb800 00000020:00000080:3.0:1788666815.436796:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666815.437813:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666815.437822:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.437824:0:22786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788666815.437827:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666815.437830:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666815.437855:0:22786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788666815.437862:0:22786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff937065bbb800 00000020:00000080:3.0:1788666815.437864:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788666815.437931:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22786:1875552525059200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666815.438001:0:22786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.438056:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370512659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666815.438197:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525059200 00000100:00100000:1.0:1788666815.438204:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525059200 00000100:00100000:1.0:1788666815.438252:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666815.438261:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+11:22786:x1875552525059200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666815.438424:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+11:22786:x1875552525059200:12345-0@lo:502:llog_process_th.0 Request processed in 163us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666815.438431:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788666815.438940:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22786:1875552525059200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788666815.443241:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666815.443254:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666815.443257:0:22786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788666815.443262:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788666815.445018:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788666815.445055:0:22737:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788666815.445603:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.445618:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666815.445677:0:22737:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788666815.445681:0:22737:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff937065bbb800 10000000:01000000:3.0:1788666815.445684:0:22737:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff937065bbb800 10000000:01000000:3.0:1788666815.445688:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788666815.445693:0:22737:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff937065bbb800 from 1 10000000:01000000:3.0:1788666815.445696:0:22737:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788666815.445729:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f9600/0x4267b949b564abef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.445738:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370582f9600/0x4267b949b564abef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.445749:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370582f9600/0x4267b949b564abef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.445771:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525059328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666815.445830:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666815.445879:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525059328 00000100:00100000:0.0:1788666815.445885:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525059328 00000100:00100000:3.0:1788666815.445893:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265300 going to sleep for 11 seconds 00000100:00100000:0.0:1788666815.445921:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788666815.445930:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+11:22737:x1875552525059328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666815.445943:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666815.445955:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937082044e00/0x4267b949b564abf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564abef expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.445990:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937082044e00/0x4267b949b564abf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564abef expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.446001:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937082044e00/0x4267b949b564abf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564abef expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.446020:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937082044e00, rc 0) 00000100:00100000:0.0:1788666815.446057:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+12:22737:x1875552525059328:12345-0@lo:101:mount.lustre.0 Request processed in 128us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666815.446064:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666815.447357:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525059328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666815.447382:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370582f9600/0x4267b949b564abef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abf6 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.447393:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370582f9600/0x4267b949b564abef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564abf6 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.447578:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525059456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666815.447629:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.447675:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265300 going to sleep for 11 seconds 00000100:00100000:3.0:1788666815.447698:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525059456 00000100:00100000:3.0:1788666815.447704:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525059456 00000100:00100000:3.0:1788666815.447744:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788666815.447752:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:22737:x1875552525059456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666815.447889:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:22737:x1875552525059456:12345-0@lo:501:mount.lustre.0 Request processed in 137us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666815.447897:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788666815.447935:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525059456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666815.447977:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525059584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666815.448023:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.448037:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265300 going to sleep for 11 seconds 00000100:00100000:0.0:1788666815.450519:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525059584 00000100:00100000:0.0:1788666815.450533:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525059584 00000100:00100000:0.0:1788666815.450591:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788666815.450601:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+12:22737:x1875552525059584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666815.463560:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+12:22737:x1875552525059584:12345-0@lo:503:mount.lustre.0 Request processed in 12950us (15538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666815.463574:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788666815.463680:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525059584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666815.464434:0:22790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f600a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22790:1875552525059712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666815.464495:0:22790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666815.464539:0:22790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.464588:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525059712 00000100:00100000:2.0:1788666815.464595:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525059712 00000100:00100000:2.0:1788666815.464640:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788666815.464650:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+12:22790:x1875552525059712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666815.464771:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+12:22790:x1875552525059712:12345-0@lo:502:llog_process_th.0 Request processed in 122us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.464792:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788666815.465042:0:22790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f600a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22790:1875552525059712:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788666815.465102:0:22790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788666815.465128:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93707b514d40) 00000020:00000080:0.0:1788666815.465147:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788666815.465263:0:22790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff937065bbb800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788666815.465268:0:22790:0:(tgt_mount.c:187:server_put_mount()) put mount ffff937065bbb800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788666815.465275:0:22790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff937065bbb800 4 00010000:00080000:0.0:1788666815.465302:0:22790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93706604b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.134@tcp at head 00010000:00010000:0.0:1788666815.470276:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788666815.470472:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788666815.470515:0:22790:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788666815.470529:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4267b949b564ac04 00000100:00080000:0.0:1788666815.470538:0:22790:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788666815.470544:0:22790:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93706604b800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666815.470577:0:22790:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93707f600a80 x1875552525059840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666815.470598:0:22790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788666815.472910:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875552525059840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666815.472982:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.473674:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525059840 00000100:00100000:3.0:1788666815.473684:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525059840 00000100:00100000:3.0:1788666815.473725:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666815.473734:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875552525059840:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788666815.473798:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875552525059840:12345-0@lo:38:llog_process_th.0 Request processed in 63us (815us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788666815.473805:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666815.474389:0:22790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22790:1875552525059968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666815.474447:0:22790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666815.474477:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525059968 00000100:00100000:0.0:1788666815.474481:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525059968 00000100:00100000:0.0:1788666815.474510:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788666815.474516:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+12:22790:x1875552525059968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666815.474615:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+12:22790:x1875552525059968:12345-0@lo:502:llog_process_th.0 Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666815.474622:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788666815.474668:0:22790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666815.474689:0:22790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22790:1875552525059968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666815.474732:0:22790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22790:1875552525060096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666815.474770:0:22790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666815.474784:0:22790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.474961:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525060096 00000100:00100000:2.0:1788666815.474967:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525060096 00000100:00100000:2.0:1788666815.474996:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788666815.475004:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:22790:x1875552525060096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666815.475101:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:22790:x1875552525060096:12345-0@lo:502:llog_process_th.0 Request processed in 98us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.475324:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788666815.475439:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666815.475446:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93706604b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666815.475451:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788666815.475454:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875552525059840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666815.475486:0:22790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a62c9863-c7b0-471d-812b-42670ca06572:22790:1875552525060096:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788666815.475508:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788666815.475562:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788666815.475584:0:22737:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788666815.475608:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f9600/0x4267b949b564abef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abf6 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666815.475634:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370582f9600/0x4267b949b564abef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564abf6 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788666815.475679:0:22737:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788666815.475682:0:22737:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788666815.475683:0:22737:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666815.475684:0:22737:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666815.475686:0:22737:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666815.475687:0:22737:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666815.475689:0:22737:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788666815.475691:0:22737:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788666815.475693:0:22737:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666815.475694:0:22737:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788666815.475698:0:22737:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788666815.475701:0:22737:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788666815.475702:0:22737:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788666815.475703:0:22737:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666815.475704:0:22737:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666815.475706:0:22737:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666815.475707:0:22737:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666815.475708:0:22737:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788666815.475709:0:22737:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788666815.475710:0:22737:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666815.475712:0:22737:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788666815.475731:0:22737:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788666815.475741:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525060224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788666815.475781:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666815.480493:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074a50c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666815.480530:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525060224 00000100:00100000:2.0:1788666815.480539:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525060224 00000100:00100000:2.0:1788666815.482758:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666815.482775:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:22737:x1875552525060224:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788666815.482906:0:22752:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788666815.482929:0:22752:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788666815.494319:0:22752:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788666815.494341:0:22752:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788666815.494483:0:22774:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788666815.494488:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788666815.494510:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.494529:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564abd3 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.494549:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.494588:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564abd3 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666815.494603:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564abd3 expref: 12 pid: 22752 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666815.494617:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525060352:0@lo:104: 00000100:00100000:3.0:1788666815.494677:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666815.494730:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051265300 going to sleep for 11 seconds 00000100:00100000:0.0:1788666815.494815:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525060352 00000100:00100000:0.0:1788666815.494827:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525060352 00000100:00100000:0.0:1788666815.494898:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666815.494907:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525060352:12345-0@lo:104: 00010000:00010000:0.0:1788666815.494918:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.494972:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788666815.494978:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525060352:12345-0@lo:104: Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666815.494985:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788666815.495006:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666815.495021:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.495029:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f8e00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788666815.495032:0:22747:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.495040:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666815.495047:0:22747:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666815.495053:0:22747:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788666815.495077:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.495084:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666815.495106:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.495119:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff9370582f8e00/0x4267b949b564abd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564abda expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666815.495136:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666815.495138:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666815.495140:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666815.495177:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666815.495186:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525060480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666815.495937:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525060352:0@lo:104: 00010000:00010000:3.0:1788666815.495956:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666815.497600:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:22737:x1875552525060224:12345-0@lo:253:mount.lustre.0 Request processed in 14826us (21811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666815.497613:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666815.497690:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:22737:1875552525060224:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788666815.497705:0:22737:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788666815.497709:0:22737:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788666815.497710:0:22737:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788666815.497711:0:22737:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666815.497713:0:22737:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666815.497714:0:22737:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666815.497715:0:22737:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666815.497716:0:22737:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788666815.497718:0:22737:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788666815.497720:0:22737:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666815.497721:0:22737:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788666815.497737:0:22737:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788666815.505469:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666815.505597:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525060480 00000100:00100000:1.0:1788666815.505607:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525060480 00010000:00010000:1.0:1788666815.505642:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564abd3 expref: 12 pid: 22752 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666815.505681:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666815.505691:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f603100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a62c9863-c7b0-471d-812b-42670ca06572+12:3641:x1875552525060480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666815.505706:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666815.505712:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564abd3 expref: 12 pid: 22752 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505724:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564abd3 expref: 12 pid: 22752 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505742:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f9c00/0x4267b949b564abda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564abd3 expref: 12 pid: 22752 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505760:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505768:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788666815.505785:0:22743:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011297079s 00010000:00010000:1.0:1788666815.505789:0:22743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505796:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505802:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505816:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505823:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f8200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666815.505827:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505881:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505899:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.505910:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666815.505979:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f603100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a62c9863-c7b0-471d-812b-42670ca06572+11:3641:x1875552525060480:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666815.505986:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788666815.506022:0:22774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.506030:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666815.506036:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f8200/0x4267b949b564ac0b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666815.506507:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525060480:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788666815.548723:0:22737:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788666815.549187:0:22737:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788666815.549256:0:22798:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1788666815.549260:0:22798:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1788666815.550392:0:22799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788666815.550893:0:22799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788666815.553186:0:22737:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788666815.554284:0:22800:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff93707f602d80 x1875552525060608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666815.554298:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00000040:01000000:3.0:1788666815.554690:0:22737:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788666815.554729:0:22737:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788666815.555198:0:22737:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788666815.555207:0:22737:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788666815.555244:0:22737:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666815.556202:0:22737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788666815.556716:0:22737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788666815.556744:0:22737:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788666815.557398:0:22799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788666815.557455:0:22799:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788666815.559371:0:22737:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788666815.560378:0:22737:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788666815.565078:0:22737:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788666815.566677:0:22737:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788666815.566716:0:22737:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7e941c67988 00100000:10000000:2.0:1788666815.566724:0:22737:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788666815.567795:0:22737:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788666815.567812:0:22737:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788666815.567867:0:22737:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788666815.567883:0:22737:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788666815.572112:0:22737:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788666815.572335:0:22737:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788666816.158855:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788666816.220921:0:22756:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788666816.220930:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff937065bbb800 from 11 10000000:01000000:0.0:1788666816.220936:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788666816.220983:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666816.220996:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666816.221019:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666816.221045:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525060736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788666816.221125:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666816.221227:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666816.221271:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525060736 00000100:00100000:2.0:1788666816.221278:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525060736 00000100:00100000:2.0:1788666816.221328:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788666816.221337:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+11:22756:x1875552525060736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666816.221351:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666816.221364:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ac12 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666816.221386:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ac12 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666816.221397:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ac12 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666816.221405:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a3a00, rc 0) 00000100:00100000:2.0:1788666816.221482:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+12:22756:x1875552525060736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666816.221489:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788666816.221551:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525060736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666816.221566:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666816.221575:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666816.221623:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525060864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788666816.221653:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666816.221707:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666816.221743:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525060864 00000100:00100000:2.0:1788666816.221747:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525060864 00000100:00100000:2.0:1788666816.221814:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788666816.221821:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:22756:x1875552525060864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788666816.221857:0:22752:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788666816.221873:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788666816.221876:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788666816.221952:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:22756:x1875552525060864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666816.221964:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788666816.221996:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525060864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788666816.222044:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788666816.222051:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666816.222058:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666816.540861:0:22794:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788666816.541358:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788666816.546210:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788666816.546232:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788666816.603959:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666817.181021:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788666817.564031:0:22794:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788666817.564040:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788666817.564168:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788666817.564209:0:22794:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788666817.564474:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1788666817.628020:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666818.208040:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666818.652374:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666819.228371:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788666819.454373:0:23042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg634-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788666819.675933:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666820.257405:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788666820.398521:0:23094:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788666820.399038:0:23094:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1788666820.511942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788666820.511949:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788666820.511953:0:8:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666820.511961:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1788666820.511967:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788666820.511974:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937044125000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666820.512005:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93707f602300 x1875552525061120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666820.512024:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666820.512033:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666820.512036:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666820.512039:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666820.512041:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788666820.512044:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788666820.512046:0:8:0:(import.c:65:import_set_state_nolock()) ffff93706604b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666820.512051:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93706604b800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666820.512064:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93707f603800 x1875552525061248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788666820.512095:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525061120:0@lo:38:kworker.0 00000100:00100000:0.0:1788666820.512155:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666820.512206:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875552525061248:0@lo:38:kworker.0 00000100:00100000:0.0:1788666820.512234:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666820.512277:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525061120 00000100:00100000:0.0:1788666820.512284:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525061120 00000100:00100000:0.0:1788666820.512311:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788666820.512317:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875552525061120:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788666820.512334:0:22764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788666820.512373:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875552525061120:12345-0@lo:38:kworker.0 Request processed in 54us (217us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788666820.512379:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788666820.512413:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666820.512417:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788666820.512421:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525061120:0@lo:38:kworker.0 00000100:00100000:3.0:1788666820.512496:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666820.512511:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525060992:0@lo:400:kworker.0 00000100:00100000:3.0:1788666820.512542:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666820.512631:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525060992 00000100:00100000:0.0:1788666820.512636:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525060992 00000100:00100000:1.0:1788666820.512660:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525061248 00000100:00100000:1.0:1788666820.512666:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525061248 00000100:00100000:1.0:1788666820.512694:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666820.512699:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875552525061248:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788666820.512718:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 643 last 0 00000020:00000080:1.0:1788666820.512980:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4267b949b564ac20 00000004:00100000:1.0:1788666820.513006:0:22760:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788666820.513159:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9370523cd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666820.513216:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875552525061248:12345-0@lo:38:kworker.0 Request processed in 515us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666820.513224:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788666820.513274:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93707f603800 x1875552525061248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788666820.513287:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788666820.513294:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788666820.513299:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788666820.513301:0:3637:0:(import.c:65:import_set_state_nolock()) ffff93706604b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788666820.513308:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875552525061248:0@lo:38:kworker.0 00000100:00100000:0.0:1788666820.513444:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788666820.513454:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:3640:x1875552525060992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666820.513495:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:3640:x1875552525060992:12345-0@lo:400:kworker.0 Request processed in 44us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666820.513501:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788666820.513956:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525060992:0@lo:400:kworker.0 00000100:00100000:1.0:1788666820.700032:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00000020:00000004:0.0:1788666821.108482:0:23144:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788666821.108666:0:23144:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788666821.276602:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666821.734735:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666822.304737:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666822.748983:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666823.325336:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666823.780361:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666824.349010:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666824.799035:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788666825.377821:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666825.630432:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666815/real 1788666815] req@ffff937074ac5180 x1875552525058176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666825 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666825.630466:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff937074ac5180 x1875552525058176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666825 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666825.630475:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666815/real 1788666815] req@ffff937074ac6a00 x1875552525058048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666825 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666825.630485:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff937074ac6a00 x1875552525058048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666825 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788666825.630503:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9370523ca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666825.630580:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788666825.630585:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525058176:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788666825.630591:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f43c77800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788666825.634454:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788666825.634460:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788666825.634464:0:37:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666825.634471:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:1.0:1788666825.634477:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788666825.634484:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937044125000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666825.634507:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac6300 x1875552525061504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666825.634519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666825.634522:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788666825.634524:0:37:0:(import.c:65:import_set_state_nolock()) ffff936f43c77800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666825.634527:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1788666825.634530:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788666825.634534:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff936f43c77800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666825.634545:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac5f80 x1875552525061632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666825.634554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666825.634557:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788666825.634558:0:37:0:(import.c:65:import_set_state_nolock()) ffff9370523ca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666825.634561:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1788666825.634564:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788666825.634567:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9370523ca800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666825.634578:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac4700 x1875552525061760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666825.634659:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525061376:0@lo:400:kworker.0 00000100:00100000:1.0:1788666825.634728:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666825.634782:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666825.634788:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525061888:0@lo:400:kworker.0 00000100:00100000:1.0:1788666825.634816:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666825.637895:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525061888 00000100:00100000:1.0:1788666825.637906:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525061888 00000100:00100000:1.0:1788666825.637966:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666825.637976:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525061888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666825.638061:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525061888:12345-0@lo:400:kworker.0 Request processed in 87us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666825.638068:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788666825.638110:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff937074ac4a80 x1875552525061888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666825.638125:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525061888:0@lo:400:kworker.0 00000100:00080000:3.0:1788666825.640105:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788666825.640115:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525058048:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788666825.640149:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525061504:0@lo:38:kworker.0 00000100:00100000:3.0:1788666825.640259:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666825.640291:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525061632:0@lo:8:kworker.0 00000400:00000100:3.0:1788666825.640310:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525061632 offset 0 length 520: 4 00000100:00100000:3.0:1788666825.640335:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525061760:0@lo:8:kworker.0 00000400:00000100:3.0:1788666825.640352:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525061760 offset 0 length 520: 4 00000100:00100000:3.0:1788666825.640380:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525061376 00000100:00100000:3.0:1788666825.640393:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525061376 00000100:00100000:3.0:1788666825.640559:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788666825.640568:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+12:3638:x1875552525061376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666825.640622:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+12:3638:x1875552525061376:12345-0@lo:400:kworker.0 Request processed in 55us (5894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666825.640622:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525061504 00000100:00100000:2.0:1788666825.640627:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525061504 00000100:00100000:3.0:1788666825.640629:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788666825.640648:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666825.640653:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875552525061504:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788666825.640669:0:22764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788666825.640673:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525061376:0@lo:400:kworker.0 00000100:00100000:2.0:1788666825.640721:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875552525061504:12345-0@lo:38:kworker.0 Request processed in 66us (461us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788666825.640727:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788666825.640727:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788666825.640731:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788666825.640733:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525061504:0@lo:38:kworker.0 00000100:00100000:2.0:1788666825.821277:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666826.400093:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666826.843967:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788666827.419913:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788666827.475818:0:23489:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:1.0:1788666827.475822:0:23489:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788666827.475824:0:23489:0:(obd_mount.c:927:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788666827.475988:0:23489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9370523c9800 00000020:01000004:1.0:1788666827.476003:0:23489:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788666827.476015:0:23489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788666827.476029:0:23489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff937066b519c0) 00000020:00000080:1.0:1788666827.476045:0:23489:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788666827.546109:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788666827.547132:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.554136:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.554405:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.558355:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.558994:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.559751:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.560248:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.560601:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.560861:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.561248:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.561666:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.561941:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.562296:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.562924:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.563873:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.564599:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.564936:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.566287:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.566736:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.567191:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.567388:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.567766:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.568249:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.568617:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.568976:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.569309:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.569664:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.570073:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.570269:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.570581:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.570911:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.571223:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788666827.571600:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788666827.573295:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788666827.573612:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788666827.574173:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788666827.574355:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788666827.574685:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788666827.575245:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788666827.575643:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788666827.576251:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788666827.576638:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788666827.576928:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788666827.577296:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788666827.577665:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788666827.580748:0:23489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788666827.581326:0:23489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788666827.581340:0:23489:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788666827.581354:0:23489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4267b949b564ac2e 00000020:01000004:3.0:1788666827.581362:0:23489:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788666827.581387:0:23489:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788666827.581497:0:23489:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.206.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788666827.581563:0:23489:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788666827.581605:0:23489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788666827.581620:0:23489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.134@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788666827.587958:0:23489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788666827.588079:0:23489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.134@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788666827.588084:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788666827.588086:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788666827.588088:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666827.588089:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666827.588090:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666827.588092:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666827.588093:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666827.588095:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666827.588096:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788666827.588101:0:23489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788666827.588104:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666827.588105:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788666827.588106:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666827.588107:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666827.588108:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666827.588109:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666827.588110:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666827.588111:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666827.588112:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788666827.588148:0:23489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788666827.588175:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062016:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788666827.588614:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666827.588687:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370412ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1788666827.588720:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525062016 00000100:00100000:0.0:1788666827.588732:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525062016 00000100:00100000:0.0:1788666827.588817:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788666827.588829:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:23489:x1875552525062016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788666827.588909:0:22752:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788666827.588913:0:22752:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788666827.588921:0:22752:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788666827.593277:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+12:23489:x1875552525062016:12345-0@lo:253:mount.lustre.0 Request processed in 4437us (4656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666827.593380:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788666827.594016:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062016:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788666827.594037:0:23489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788666827.594041:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788666827.594043:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788666827.594044:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666827.594045:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666827.594046:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666827.594048:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666827.594049:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666827.594051:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666827.594069:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788666827.594136:0:23489:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9370523c9800 from lustre-MDT0001 10000000:01000000:3.0:1788666827.594172:0:23489:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788666827.594175:0:23489:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788666827.594182:0:23489:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff937072250000 local copy 00010000:00010000:3.0:1788666827.594191:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666827.594303:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666827.594372:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666827.594428:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370412ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1788666827.595445:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525062144 00000100:00100000:0.0:1788666827.595467:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525062144 00000100:00100000:0.0:1788666827.595676:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788666827.595688:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+12:23489:x1875552525062144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666827.595802:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+12:23489:x1875552525062144:12345-0@lo:501:mount.lustre.0 Request processed in 117us (1430us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788666827.595809:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788666827.596033:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062144:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788666827.596195:0:23489:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788666827.596253:0:23489:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788666827.596263:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.596276:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666827.596314:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9370523c9800 10000000:01000000:2.0:1788666827.596320:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788666827.596326:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff937072250000 10000000:01000000:2.0:1788666827.596329:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788666827.596333:0:23489:0:(mgc_request.c:1800:mgc_process_log()) Process log nodemap-ffff937072250000 from 1 10000000:01000000:2.0:1788666827.596336:0:23489:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788666827.596376:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3600/0x4267b949b564ac35 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.596385:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a3600/0x4267b949b564ac35 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.597723:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a3600/0x4267b949b564ac35 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666827.598221:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666827.598327:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666827.603161:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525062272 00000100:00100000:0.0:1788666827.603178:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525062272 00000100:00100000:0.0:1788666827.603280:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788666827.603302:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+12:23489:x1875552525062272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666827.603320:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666827.603342:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937082045c00/0x4267b949b564ac3c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ac35 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666827.603381:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937082045c00/0x4267b949b564ac3c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ac35 expref: 13 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666827.603394:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937082045c00/0x4267b949b564ac3c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ac35 expref: 13 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666827.603403:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937082045c00, rc 0) 00000100:00100000:0.0:1788666827.603459:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+13:23489:x1875552525062272:12345-0@lo:101:mount.lustre.0 Request processed in 170us (5132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666827.603465:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788666827.610648:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066b5f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666827.610693:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666827.610721:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a3600/0x4267b949b564ac35 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac3c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.610752:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a3600/0x4267b949b564ac35 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ac3c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666827.610780:0:23489:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788666827.610791:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3600/0x4267b949b564ac35 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac3c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.610799:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a3600/0x4267b949b564ac35 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac3c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666827.610811:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9370523c9800 10000000:01000000:1.0:1788666827.611496:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788666827.611503:0:23489:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff9370523c9800 from 1 10000000:01000000:1.0:1788666827.611506:0:23489:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788666827.611692:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031e00/0x4267b949b564ac43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.611701:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937040031e00/0x4267b949b564ac43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.611709:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937040031e00/0x4267b949b564ac43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666827.611729:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788666827.611791:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666827.611886:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525062400 00000100:00100000:3.0:1788666827.611895:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525062400 00000100:00100000:3.0:1788666827.611960:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788666827.611971:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+13:23489:x1875552525062400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666827.611984:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666827.612000:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f8000/0x4267b949b564ac4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ac43 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.612022:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f8000/0x4267b949b564ac4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ac43 expref: 14 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.612032:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f8000/0x4267b949b564ac4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ac43 expref: 14 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.612040:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f8000, rc 0) 00000100:00100000:1.0:1788666827.612194:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042d5c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.618675:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+14:23489:x1875552525062400:12345-0@lo:101:mount.lustre.0 Request processed in 6689us (6866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.618690:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788666827.619090:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666827.619117:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937040031e00/0x4267b949b564ac43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac4a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.619149:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937040031e00/0x4267b949b564ac43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ac4a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666827.619172:0:23489:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788666827.619233:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031e00/0x4267b949b564ac43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac4a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.619242:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937040031e00/0x4267b949b564ac43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac4a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666827.619250:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788666827.619255:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788666827.619261:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9370523c9800 10000000:01000000:1.0:1788666827.619263:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788666827.619267:0:23489:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788666827.619269:0:23489:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788666827.619301:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031600/0x4267b949b564ac51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.619308:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937040031600/0x4267b949b564ac51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.619318:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937040031600/0x4267b949b564ac51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666827.619338:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788666827.619380:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.619427:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042d5c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.619568:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525062528 00000100:00100000:2.0:1788666827.619588:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525062528 00000100:00100000:2.0:1788666827.619640:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788666827.619650:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+14:23489:x1875552525062528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666827.619792:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666827.619814:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a3c00/0x4267b949b564ac58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ac51 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.620092:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a3c00/0x4267b949b564ac58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ac51 expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.620105:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a3c00/0x4267b949b564ac58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ac51 expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.620115:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a3c00, rc 0) 00000100:00100000:2.0:1788666827.620171:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525062528:12345-0@lo:101:mount.lustre.0 Request processed in 522us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.620178:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788666827.620272:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666827.620286:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937040031600/0x4267b949b564ac51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac58 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.620294:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937040031600/0x4267b949b564ac51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ac58 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666827.623355:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788666827.625352:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666827.629522:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788666827.629600:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788666827.629617:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788666827.629632:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788666827.629647:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788666827.629664:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788666827.629677:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788666827.629690:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788666827.629703:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788666827.629717:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788666827.629731:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788666827.629743:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788666827.629756:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788666827.629768:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788666827.629782:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788666827.629794:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788666827.629807:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788666827.629821:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788666827.629860:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788666827.629877:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788666827.629891:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788666827.629905:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788666827.629919:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788666827.629959:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788666827.629977:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788666827.629992:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788666827.630005:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788666827.630019:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788666827.630033:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788666827.630047:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788666827.630061:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788666827.630076:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788666827.630090:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788666827.630103:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788666827.630117:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788666827.630131:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788666827.630145:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788666827.630159:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788666827.630172:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788666827.630184:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788666827.630195:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788666827.630207:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788666827.630222:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788666827.630235:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788666827.630267:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788666827.630274:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788666827.630552:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666827.630642:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.630818:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042d5c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.631043:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525062656 00000100:00100000:2.0:1788666827.631064:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525062656 00000100:00100000:2.0:1788666827.631168:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788666827.631181:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525062656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666827.631380:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525062656:12345-0@lo:501:mount.lustre.0 Request processed in 201us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.631389:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788666827.631606:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666827.631649:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666827.631700:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.631953:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042d5c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788666827.632044:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525062784 00000100:00100000:3.0:1788666827.632051:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525062784 00000100:00100000:3.0:1788666827.632081:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788666827.632088:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525062784:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666827.632969:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525062784:12345-0@lo:503:mount.lustre.0 Request processed in 875us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.632979:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788666827.633113:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788666827.633802:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788666827.633935:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666827.634006:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.634048:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042d5c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788666827.634123:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525062912 00000100:00100000:3.0:1788666827.634131:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525062912 00000100:00100000:3.0:1788666827.634166:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788666827.634176:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525062912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666827.634985:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525062912:12345-0@lo:502:mount.lustre.0 Request processed in 807us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.634994:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788666827.635194:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525062912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666827.635752:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788666827.635789:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1788666827.635804:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1788666827.635818:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1788666827.635868:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1788666827.635887:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1788666827.635905:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1788666827.635921:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1788666827.635936:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1788666827.635962:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1788666827.635978:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1788666827.635993:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1788666827.636008:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1788666827.636022:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1788666827.636042:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1788666827.636055:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1788666827.636068:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1788666827.636083:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1788666827.636096:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1788666827.636110:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1788666827.636125:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1788666827.636138:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1788666827.636152:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1788666827.636166:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1788666827.636194:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1788666827.636209:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1788666827.636222:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1788666827.636237:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1788666827.636252:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1788666827.636266:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1788666827.636279:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1788666827.636292:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1788666827.636304:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1788666827.636316:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1788666827.636328:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1788666827.636340:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1788666827.636356:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1788666827.636371:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1788666827.636384:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1788666827.636416:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1788666827.636431:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1788666827.636445:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1788666827.636458:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1788666827.636471:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1788666827.636518:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525063040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666827.636593:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.636653:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042d5c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788666827.636812:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525063040 00000100:00100000:3.0:1788666827.636822:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525063040 00000100:00100000:3.0:1788666827.636896:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788666827.636906:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525063040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666827.637050:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525063040:12345-0@lo:502:mount.lustre.0 Request processed in 145us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.637058:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788666827.637464:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525063040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666827.637535:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788666827.637546:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788666827.638518:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666827.638533:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666827.638536:0:23493:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788666827.638542:0:23493:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788666827.638545:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666827.638568:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff937066b53380) 00000020:00000080:1.0:1788666827.638597:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788666827.638604:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788666827.638706:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788666827.638714:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4267b949b564ac66 00000020:00000080:1.0:1788666827.639140:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788666827.639146:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666827.639151:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666827.639153:0:23493:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788666827.639156:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666827.639160:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666827.639161:0:23493:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788666827.639165:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666827.639174:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff937066b50000) 00000020:00000080:1.0:1788666827.639187:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788666827.639192:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788666827.639193:0:23493:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788666827.639196:0:23493:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788666827.639203:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788666827.639273:0:23493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9370523c9800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788666827.639289:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff937066b54d40) 00000020:00000080:1.0:1788666827.639299:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788666827.639374:0:23493:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788666827.639381:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4267b949b564ac7b 00000020:00000080:1.0:1788666827.639560:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788666827.639569:0:23493:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788666827.639574:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4267b949b564ac82 00080000:01000000:1.0:1788666827.639580:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788666827.639584:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4267b949b564ac89 00010000:00010000:2.0:1788666827.741295:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788666827.742225:0:23493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788666827.743453:0:23493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788666827.744541:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788666827.744553:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666827.744560:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666827.744563:0:23493:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788666827.744567:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666827.744573:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666827.744575:0:23493:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788666827.744578:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788666827.744583:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.134@tcp to nid 0x20000c0a8ce86 (192.168.206.134@tcp) 00000020:00000080:2.0:1788666827.744611:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788666827.744690:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9370722519c0) 00000020:00000080:2.0:1788666827.744713:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788666827.744720:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788666827.744798:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788666827.744805:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788666827.744812:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4267b949b564ac97 00010000:00080000:2.0:1788666827.744880:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff936f4454c800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.134@tcp at head 00010000:00010000:2.0:1788666827.749077:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788666827.750996:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788666827.751021:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788666827.751086:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788666827.751121:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4267b949b564ac9e 00000100:00080000:3.0:1788666827.751137:0:23493:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788666827.751145:0:23493:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff936f4454c800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:3.0:1788666827.751199:0:23493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43761180 x1875552525063168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788666827.751282:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525063168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788666827.751389:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788666827.751849:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788666827.751996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788666827.752001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788666827.752004:0:36:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788666827.752009:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:3.0:1788666827.752014:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788666827.752019:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937044125000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:3.0:1788666827.752043:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43761c00 x1875552525063296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788666827.752116:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525063168 00000100:00100000:2.0:1788666827.752126:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525063168 00000100:00100000:2.0:1788666827.752165:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666827.752181:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875552525063168:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788666827.752214:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1788666827.752324:0:22764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4267b949b564aca5 00000004:00100000:2.0:1788666827.752347:0:22764:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788666827.752355:0:22764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:2.0:1788666827.752551:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666827.752558:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666827.752561:0:23493:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788666827.752565:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788666827.752568:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788666827.752571:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788666827.752573:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788666827.752575:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788666827.752577:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666827.752579:0:23493:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788666827.752582:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666827.752589:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666827.752592:0:23493:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788666827.752598:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788666827.752656:0:23493:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788666827.752683:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666827.752686:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666827.752688:0:23493:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788666827.752691:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788666827.752693:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788666827.752694:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788666827.752696:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788666827.752698:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788666827.752702:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666827.752703:0:23493:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788666827.752706:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788666827.752710:0:23493:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788666827.752722:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666827.752723:0:23493:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788666827.752727:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788666827.752732:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.134@tcp to nid 0x20000c0a8ce86 (192.168.206.134@tcp) 00000020:01000000:2.0:1788666827.752762:0:23493:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788666827.752766:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788666827.752785:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9370510199c0) 00000020:00000080:2.0:1788666827.752804:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788666827.752811:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788666827.752998:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788666827.753007:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788666827.753016:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4267b949b564acb3 00010000:00080000:2.0:1788666827.753062:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937074b3b000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.134@tcp at head 00010000:00010000:2.0:1788666827.753370:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788666827.755567:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525063296:0@lo:38:kworker.0 00000100:00100000:0.0:1788666827.755677:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.755998:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788666827.756016:0:22763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788666827.756703:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525063296 00000100:00100000:0.0:1788666827.756717:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525063296 00000100:00100000:1.0:1788666827.756903:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788666827.756915:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875552525063296:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1788666827.757266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666827.757273:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788666827.757276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666827.757279:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788666827.757359:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666827.757375:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525063424:0@lo:400:kworker.0 00000100:00100000:3.0:1788666827.758237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.758255:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875552525063296:12345-0@lo:38:kworker.0 Request processed in 1332us (2571us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788666827.758271:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788666827.758303:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525063424 00000100:00100000:3.0:1788666827.758313:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525063424 00000100:00100000:3.0:1788666827.758368:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788666827.758379:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525063424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666827.758457:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525063424:12345-0@lo:400:kworker.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.758465:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788666827.758519:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff936f43762d80 x1875552525063424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666827.758536:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525063424:0@lo:400:kworker.0 00000100:00100000:1.0:1788666827.758933:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788666827.758941:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788666827.758955:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788666827.758962:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525063296:0@lo:38:kworker.0 00000040:01000000:3.0:1788666827.759115:0:23493:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788666827.760350:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788666827.763593:0:22764:0:(import.c:65:import_set_state_nolock()) ffff936f43eda800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666827.763723:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1875552525063168:12345-0@lo:38:llog_process_th.0 Request processed in 11540us (12333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.763741:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666827.765583:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788666827.765610:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788666827.765619:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788666827.765631:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788666827.765635:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f4454c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788666827.765661:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525063168:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788666827.766194:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788666827.766537:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666827.766563:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525063552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666827.766656:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788666827.766809:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:2.0:1788666827.766994:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525063552 00000100:00100000:2.0:1788666827.767004:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525063552 00000040:00080000:3.0:1788666827.767349:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1788666827.767674:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666827.767687:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875552525063552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788666827.767752:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000040:00080000:0.0:1788666827.769291:0:23499:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788666827.769301:0:23499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788666827.770771:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875552525063552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3077us (4105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.770784:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666827.770910:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525063552:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1788666827.773549:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788666827.773975:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788666827.774121:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788666827.774226:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4267b949b564acba 00000100:00080000:0.0:1788666827.774241:0:23493:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788666827.774249:0:23493:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff937074b3b000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666827.774298:0:23493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93707f601f80 x1875552525063680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666827.774389:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525063680:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788666827.774467:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525063680 offset 0 length 520: 4 00000100:00080000:0.0:1788666827.775096:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788666827.775199:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666827.775206:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666827.775208:0:23493:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788666827.775211:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788666827.775219:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788666827.775221:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788666827.775223:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788666827.775225:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788666827.775228:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666827.775230:0:23493:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788666827.775232:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788666827.775252:0:23493:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788666827.775256:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666827.775258:0:23493:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788666827.775262:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788666827.775267:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.134@tcp to nid 0x20000c0a8ce86 (192.168.206.134@tcp) 00000020:01000000:0.0:1788666827.775309:0:23493:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788666827.775313:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788666827.775331:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93707b510000) 00000020:00000080:0.0:1788666827.775352:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788666827.775359:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:3.0:1788666827.775511:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666827.775517:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788666827.775520:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666827.775524:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:0.0:1788666827.775709:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788666827.775719:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788666827.775728:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4267b949b564acc8 00010000:00080000:0.0:1788666827.775768:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937074b3b800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.134@tcp at head 00010000:00010000:0.0:1788666827.776763:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788666827.776997:0:23493:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788666827.777020:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788666827.785200:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666827.785636:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788666827.785865:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788666827.787328:0:23501:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788666827.787336:0:23501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788666827.791115:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788666827.791138:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788666827.791558:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788666827.791592:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4267b949b564accf 00000100:00080000:3.0:1788666827.791607:0:23493:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788666827.791615:0:23493:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937074b3b800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:3.0:1788666827.791705:0:23493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43763b80 x1875552525063808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666827.791782:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525063808:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788666827.792050:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525063808 offset 0 length 520: 4 00000100:00080000:3.0:1788666827.792141:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788666827.792236:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666827.792242:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.792244:0:23493:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788666827.792247:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666827.792252:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.792254:0:23493:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788666827.792256:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788666827.792258:0:23493:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788666827.792261:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666827.792270:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.792272:0:23493:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788666827.792275:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666827.792277:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.792278:0:23493:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788666827.792282:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788666827.792329:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666827.792332:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.792333:0:23493:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788666827.792336:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1788666827.792563:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788666827.792602:0:23489:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788666827.792630:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031600/0x4267b949b564ac51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac58 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.792644:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937040031600/0x4267b949b564ac51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ac58 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666827.792667:0:23489:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9370523c9800 from 1 10000000:01000000:2.0:1788666827.792670:0:23489:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788666827.792703:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.792712:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.792726:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666827.792745:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525063936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666827.792798:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.792823:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.792883:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525063936 00000100:00100000:2.0:1788666827.792891:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525063936 00000100:00100000:2.0:1788666827.792955:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788666827.792965:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+15:23489:x1875552525063936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666827.792982:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666827.792998:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564acd6 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.793027:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564acd6 expref: 16 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.793040:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564acd6 expref: 16 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.793061:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a3400, rc 0) 00000100:00100000:2.0:1788666827.793105:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+16:23489:x1875552525063936:12345-0@lo:101:mount.lustre.0 Request processed in 140us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.793112:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788666827.793171:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525063936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666827.793186:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.793195:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666827.793724:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064064:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788666827.793764:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.793784:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.793802:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525064064 00000100:00100000:2.0:1788666827.793807:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525064064 00000100:00100000:2.0:1788666827.793857:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788666827.793864:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+16:23489:x1875552525064064:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788666827.793878:0:22752:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788666827.793896:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788666827.793899:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788666827.793983:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+16:23489:x1875552525064064:12345-0@lo:256:mount.lustre.0 Request processed in 119us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.793991:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788666827.794025:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064064:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788666827.794609:0:23489:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788666827.794618:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.794628:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666827.794636:0:23489:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9370523c9800 from 1 10000000:01000000:2.0:1788666827.794639:0:23489:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788666827.794665:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.794673:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.794681:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666827.794695:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666827.794729:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.794774:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.794792:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525064192 00000100:00080000:0.0:1788666827.794792:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788666827.794796:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525064192 00000100:00080000:0.0:1788666827.794797:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788666827.794826:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788666827.794859:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+16:23489:x1875552525064192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666827.794870:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788666827.794881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00010000:2.0:1788666827.794884:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ace4 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788666827.794885:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788666827.794916:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ace4 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.794927:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ace4 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.794936:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a2c00, rc 0) 00000100:00100000:2.0:1788666827.794993:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064192:12345-0@lo:101:mount.lustre.0 Request processed in 160us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.795000:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788666827.795238:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666827.795253:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666827.795269:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788666827.797131:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788666827.799531:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666827.799830:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788666827.801279:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788666827.801314:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788666827.801332:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788666827.801346:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788666827.801359:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788666827.801374:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788666827.801388:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788666827.801480:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788666827.801497:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788666827.801510:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788666827.801537:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788666827.801543:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788666827.801697:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666827.801794:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.802242:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666827.803553:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525064320 00000100:00100000:0.0:1788666827.803573:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525064320 00000100:00100000:0.0:1788666827.803691:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788666827.803707:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666827.804138:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064320:12345-0@lo:501:mount.lustre.0 Request processed in 434us (2341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.804147:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788666827.804240:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666827.804301:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f603480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666827.804366:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666827.804628:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074aadf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.804675:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525064448 00000100:00100000:2.0:1788666827.804682:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525064448 00000100:00100000:2.0:1788666827.804711:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788666827.804719:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064448:12345-0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788666827.805469:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788666827.806523:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064448:12345-0@lo:503:mount.lustre.0 Request processed in 1797us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.806538:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788666827.806700:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f603480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788666827.807823:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666827.808197:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666827.808284:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.808379:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666827.808501:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525064576 00000100:00100000:0.0:1788666827.808510:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525064576 00000100:00100000:0.0:1788666827.808605:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788666827.808617:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666827.808761:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064576:12345-0@lo:502:mount.lustre.0 Request processed in 146us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666827.808769:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788666827.808904:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666827.809168:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788666827.809200:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1788666827.809217:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1788666827.809231:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1788666827.809244:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1788666827.809258:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788666827.809272:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1788666827.809285:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1788666827.809299:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788666827.809311:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1788666827.809325:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1788666827.809357:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666827.809585:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666827.809778:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042bfe780 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.809966:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525064704 00000100:00100000:2.0:1788666827.809974:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525064704 00000100:00100000:2.0:1788666827.810008:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788666827.810016:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666827.810118:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064704:12345-0@lo:502:mount.lustre.0 Request processed in 101us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.810126:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788666827.810256:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666827.810318:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1788666827.810339:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788666827.811457:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666827.811474:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.811477:0:23503:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788666827.811488:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9370523c9800 00000020:00000080:3.0:1788666827.811491:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666827.811501:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666827.811504:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.811506:0:23503:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788666827.811508:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666827.811510:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.811511:0:23503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788666827.811515:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9370523c9800 00000020:00000080:3.0:1788666827.811517:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666827.811588:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666827.811592:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.811594:0:23503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788666827.811597:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666827.811599:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.811600:0:23503:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788666827.811604:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9370523c9800 00000020:00000080:3.0:1788666827.811606:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666827.811623:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666827.811625:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.811627:0:23503:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788666827.811630:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666827.811632:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.811633:0:23503:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788666827.811637:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9370523c9800 00000020:00000080:3.0:1788666827.811639:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666827.811661:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666827.811664:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666827.811665:0:23503:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788666827.811668:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788666827.827583:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788666827.827718:0:23489:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788666827.827750:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.827766:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666827.828594:0:23489:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788666827.828601:0:23489:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff9370523c9800 10000000:01000000:2.0:1788666827.828605:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9370523c9800 10000000:01000000:2.0:1788666827.828610:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788666827.828619:0:23489:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9370523c9800 from 1 10000000:01000000:2.0:1788666827.828622:0:23489:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788666827.828824:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3000/0x4267b949b564acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.828980:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a3000/0x4267b949b564acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.830761:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a3000/0x4267b949b564acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666827.830811:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666827.830939:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.831033:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370502cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788666827.836204:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525064832 00000100:00100000:3.0:1788666827.836226:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525064832 00000100:00100000:3.0:1788666827.837124:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788666827.837139:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+17:23489:x1875552525064832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666827.837162:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666827.837186:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f8c00/0x4267b949b564acf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564acf2 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.837223:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f8c00/0x4267b949b564acf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564acf2 expref: 18 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.837235:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f8c00/0x4267b949b564acf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564acf2 expref: 18 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.837245:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f8c00, rc 0) 00000100:00100000:3.0:1788666827.838594:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525064832:12345-0@lo:101:mount.lustre.0 Request processed in 1451us (7646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.838608:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788666827.839138:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666827.839170:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a3000/0x4267b949b564acf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564acf9 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.839185:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a3000/0x4267b949b564acf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564acf9 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666827.854458:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788666827.855463:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666827.858787:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788666827.859495:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788666827.859518:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788666827.859531:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788666827.859575:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788666827.859591:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788666827.859604:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788666827.859618:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788666827.861096:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788666827.861162:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788666827.861179:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788666827.861192:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788666827.861205:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788666827.861218:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788666827.861231:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788666827.861245:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788666827.863023:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788666827.863160:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788666827.863200:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788666827.863225:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788666827.863277:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788666827.863293:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788666827.863307:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788666827.863321:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788666827.863334:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788666827.863346:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788666827.863360:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788666827.863374:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788666827.863388:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788666827.863401:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788666827.863415:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788666827.863427:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788666827.863440:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788666827.863452:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788666827.863465:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788666827.863478:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788666827.863508:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788666827.863525:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788666827.863538:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788666827.863551:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788666827.863565:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788666827.863580:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788666827.863595:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788666827.863613:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788666827.863626:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788666827.863654:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788666827.864124:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788666827.864152:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788666827.865816:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788666827.866172:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788666827.866203:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788666827.866220:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788666827.866364:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666827.866449:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.866506:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad840 going to sleep for 11 seconds 00000100:00100000:1.0:1788666827.867530:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525064960 00000100:00100000:1.0:1788666827.867543:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525064960 00000100:00100000:1.0:1788666827.867613:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788666827.867703:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525064960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666827.868132:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788666827.869326:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525064960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666827.869395:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666827.871805:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666827.871885:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525065088 00000100:00100000:3.0:1788666827.871896:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525065088 00000100:00100000:2.0:1788666827.871954:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad840 going to sleep for 11 seconds 00000100:00100000:3.0:1788666827.871974:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788666827.871987:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+19:23489:x1875552525065088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666827.872972:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+19:23489:x1875552525064960:12345-0@lo:501:mount.lustre.0 Request processed in 5336us (6518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666827.872985:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788666827.877252:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065088:12345-0@lo:503:mount.lustre.0 Request processed in 5255us (5442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.877283:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788666827.881001:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065088:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788666827.883819:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666827.884246:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666827.884499:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.884573:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad600 going to sleep for 11 seconds 00000100:00100000:1.0:1788666827.884709:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525065216 00000100:00100000:1.0:1788666827.884719:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525065216 00000100:00100000:1.0:1788666827.884812:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788666827.884823:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666827.885282:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065216:12345-0@lo:502:mount.lustre.0 Request processed in 458us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666827.885291:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788666827.885502:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666827.886757:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788666827.886799:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788666827.886815:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788666827.886830:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788666827.886898:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788666827.886916:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788666827.886932:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788666827.886959:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788666827.886978:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788666827.886999:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788666827.887018:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788666827.887032:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788666827.887045:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788666827.887059:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788666827.887104:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788666827.887121:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788666827.887135:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788666827.887151:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788666827.887168:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788666827.887184:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788666827.887200:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788666827.887218:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788666827.887235:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788666827.887251:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788666827.887283:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788666827.887299:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788666827.887313:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788666827.887329:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788666827.887345:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788666827.887363:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788666827.887407:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788666827.887426:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788666827.887439:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788666827.887451:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788666827.887463:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788666827.887474:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788666827.887485:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788666827.887496:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788666827.887506:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788666827.887517:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788666827.887528:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788666827.887541:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788666827.887554:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788666827.887567:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788666827.887581:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788666827.887595:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788666827.887622:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788666827.887643:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788666827.887709:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666827.887802:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.887893:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525065344 00000100:00100000:2.0:1788666827.887902:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525065344 00000100:00100000:2.0:1788666827.887970:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788666827.887981:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666827.888113:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065344:12345-0@lo:502:mount.lustre.0 Request processed in 133us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.888121:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788666827.888187:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.888215:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666827.888412:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788666827.888439:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788666827.888465:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666827.888505:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.888540:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525065472 00000100:00100000:2.0:1788666827.888545:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525065472 00000100:00100000:2.0:1788666827.888573:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788666827.888582:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666827.888655:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065472:12345-0@lo:502:mount.lustre.0 Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.888663:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788666827.888700:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.888713:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666827.888750:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788666827.888764:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788666827.891540:0:23509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788666827.891574:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9370475b19c0) 00000020:00000080:1.0:1788666827.891605:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788666827.891730:0:23509:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9370523c9800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788666827.891735:0:23509:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9370523c9800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788666827.891737:0:23509:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9370523c9800 3 00010000:00080000:1.0:1788666827.891777:0:23509:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9370475bf000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.134@tcp at head 00010000:00010000:1.0:1788666827.896672:0:23509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788666827.897093:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788666827.897211:0:23509:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788666827.897225:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4267b949b564ad07 00000100:00080000:1.0:1788666827.897237:0:23509:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788666827.897244:0:23509:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9370475bf000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666827.897278:0:23509:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac4a80 x1875552525065600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666827.897305:0:23509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788666827.897341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666827.897346:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666827.897349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666827.897353:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788666827.897367:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875552525065600:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666827.897486:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.897558:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525065600 00000100:00100000:1.0:1788666827.897567:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525065600 00000100:00100000:1.0:1788666827.897612:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788666827.897619:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875552525065600:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788666827.897641:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:1.0:1788666827.897671:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4267b949b564ad0e 00000004:00100000:1.0:1788666827.897686:0:22760:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788666827.897716:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9370475b8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666827.898409:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875552525065600:12345-0@lo:38:llog_process_th.0 Request processed in 784us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666827.898420:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788666827.899125:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff937074ac4a80 x1875552525065600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666827.899138:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788666827.899147:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788666827.899154:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788666827.899159:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788666827.899162:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9370475bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788666827.899170:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875552525065600:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788666827.899206:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1788666827.899483:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788666827.899524:0:23489:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788666827.899552:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3000/0x4267b949b564acf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564acf9 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.899563:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a3000/0x4267b949b564acf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564acf9 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788666827.899620:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788666827.899622:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788666827.899624:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666827.899625:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666827.899626:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666827.899627:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666827.899628:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666827.899630:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666827.899632:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666827.899635:0:23489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788666827.899642:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666827.899643:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788666827.899644:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666827.899645:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666827.899646:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666827.899647:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666827.899648:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666827.899649:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666827.899650:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666827.899669:0:23489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788666827.899685:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788666827.899737:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666827.899775:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff937049f83c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.900623:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525065728 00000100:00100000:2.0:1788666827.900639:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525065728 00000100:00100000:2.0:1788666827.900726:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788666827.900737:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788666827.900780:0:22753:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788666827.900798:0:22753:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788666827.904729:0:22738:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788666827.904808:0:22753:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788666827.904825:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788666827.906875:0:22774:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000100:00100000:2.0:1788666827.907512:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:23489:x1875552525065728:12345-0@lo:253:mount.lustre.0 Request processed in 6770us (7767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.907529:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788666827.907672:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:23489:1875552525065728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788666827.907691:0:23489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788666827.907695:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788666827.907697:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788666827.907699:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666827.907700:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666827.907701:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666827.907703:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666827.907704:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666827.907707:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666827.907709:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788666827.907728:0:23489:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 10000000:01000000:1.0:1788666827.909566:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788666827.909599:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.909621:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ac12 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.909629:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564acd6 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.909637:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.909701:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564acd6 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.909718:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564acd6 expref: 17 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666827.909734:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525065856:0@lo:104: 00000100:00100000:1.0:1788666827.909809:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.911088:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525065856 00000100:00100000:2.0:1788666827.911101:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525065856 00000100:00100000:2.0:1788666827.911156:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666827.911168:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525065856:12345-0@lo:104: 00010000:00010000:2.0:1788666827.911187:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.911481:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666827.911490:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525065856:12345-0@lo:104: Request processed in 324us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.911499:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788666827.911546:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666827.911553:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.911569:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a2400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788666827.911574:0:22746:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.911583:0:22746:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666827.911593:0:22746:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666827.911599:0:22746:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666827.911650:0:22746:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.911658:0:22746:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666827.911682:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.911691:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564acd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564acdd expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.911704:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666827.911707:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666827.911709:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666827.911737:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525065984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666827.911779:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.911856:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525065984 00000100:00100000:2.0:1788666827.911860:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525065984 00010000:00010000:1.0:1788666827.912670:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ac12 expref: 18 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666827.912692:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ac12 expref: 18 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666827.912706:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525066112:0@lo:104: 00000100:00100000:1.0:1788666827.912748:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.912780:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042d5ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666827.912805:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525065856:0@lo:104: 00000100:00100000:0.0:1788666827.913374:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525066112 00000100:00100000:0.0:1788666827.913384:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525066112 00010000:00010000:2.0:1788666827.913569:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564acd6 expref: 18 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666827.913633:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788666827.913648:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525066112:12345-0@lo:104: 00000100:00100000:2.0:1788666827.913658:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788666827.913668:0:22742:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666827.913680:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+18:3638:x1875552525065984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666827.913701:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666827.913707:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564acd6 expref: 18 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.913722:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564acd6 expref: 18 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.913743:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a3400/0x4267b949b564acdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564acd6 expref: 18 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666827.913756:0:22742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788666827.913759:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666827.913767:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525066112:12345-0@lo:104: Request processed in 123us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666827.913776:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666827.913826:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+17:3638:x1875552525065984:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.913859:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666827.913970:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525065984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666827.914014:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525066112:0@lo:104: 00010000:00010000:1.0:1788666827.914036:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.917209:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666827.917221:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.917232:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937082045600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:2.0:1788666827.917236:0:22747:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.917246:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666827.917253:0:22747:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666827.917267:0:22747:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666827.917390:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.917398:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666827.917427:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.917435:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff937082045600/0x4267b949b564ac12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ac19 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.917454:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666827.917456:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666827.917458:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666827.918261:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525066240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666827.919042:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666827.919235:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525066240 00000100:00100000:3.0:1788666827.919252:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525066240 00010000:00010000:3.0:1788666827.919363:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ac12 expref: 17 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1788666827.922072:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788666827.922226:0:23514:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788666827.922232:0:23514:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788666827.922462:0:23515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788666827.923224:0:23515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788666827.923376:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788666827.924442:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666827.924468:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+17:3639:x1875552525066240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666827.924491:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666827.924502:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ac12 expref: 17 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924519:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ac12 expref: 17 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924537:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a3a00/0x4267b949b564ac19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ac12 expref: 17 pid: 22753 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924572:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924580:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788666827.924597:0:22744:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015034990s 00010000:00010000:2.0:1788666827.924603:0:22744:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924610:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924617:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924623:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924628:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666827.924632:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.924640:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1788666827.925031:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788666827.925119:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:2.0:1788666827.926188:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666827.926212:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666827.926298:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+16:3639:x1875552525066240:12345-0@lo:103:ldlm_bl.0 Request processed in 1843us (7261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.926307:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666827.926392:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525066240:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1788666827.926866:0:23489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00010000:00010000:3.0:1788666827.927026:0:22774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.927042:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666827.927067:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937040031800/0x4267b949b564ad15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1788666827.927117:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788666827.927235:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666827.929690:0:23516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1875552525066368:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788666827.929778:0:23516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666827.930002:0:23516:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad240 going to sleep for 11 seconds 00000100:00100000:3.0:1788666827.930010:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525066368 00000100:00100000:3.0:1788666827.930028:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525066368 00000100:00100000:3.0:1788666827.930112:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788666827.930124:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1875552525066368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788666827.930306:0:23516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1875552525066368:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788666827.930364:0:23516:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788666827.930405:0:23516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1875552525066496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788666827.930446:0:23516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788666827.930791:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788666827.931009:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525066496 00000100:00100000:2.0:1788666827.931017:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525066496 00000100:00100000:2.0:1788666827.931062:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666827.931071:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:23516:x1875552525066496:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788666827.931590:0:23515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788666827.931663:0:23515:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788666827.932177:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788666827.932224:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788666827.932375:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788666827.933800:0:23489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:3.0:1788666827.935022:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:23516:x1875552525066368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4892us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666827.935038:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788666827.936061:0:23516:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad240 going to sleep for 11 seconds 00000001:00000004:1.0:1788666827.937169:0:23489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788666827.939069:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23516:x1875552525066496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 7991us (8614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.939085:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788666827.939147:0:23516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1875552525066496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788666827.939623:0:23516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23516:1875552525066624:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788666827.939692:0:23516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666827.939735:0:23516:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704a1fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.939968:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525066624 00000100:00100000:2.0:1788666827.939980:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525066624 00000100:00100000:2.0:1788666827.940026:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666827.940035:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23516:x1875552525066624:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788666827.940108:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23516:x1875552525066624:12345-0@lo:900:lod0001_rec0000.0 Request processed in 74us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.940115:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788666827.940538:0:23516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff936f43763480 x1875552525066624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788666843 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666827.940556:0:23516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23516:1875552525066624:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788666827.940645:0:23516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1875552525066752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788666827.940697:0:23516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666827.940731:0:23516:0:(client.c:2716:ptlrpc_set_wait()) set ffff937049525600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666827.940774:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525066752 00000100:00100000:2.0:1788666827.940782:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525066752 00000100:00100000:2.0:1788666827.940851:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666827.940860:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1875552525066752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788666827.940971:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1875552525066752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666827.940978:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788666827.941552:0:23516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1875552525066752:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788666827.941628:0:23516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666827.946557:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788666827.946661:0:23516:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788666827.946668:0:23516:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788666827.958913:0:23489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788666827.958979:0:23489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa7e941633988 00100000:10000000:2.0:1788666827.958989:0:23489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788666827.959590:0:23489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788666827.959636:0:23489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788666827.959660:0:23489:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788666827.959684:0:23489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788666827.978506:0:23489:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788666827.982639:0:23489:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788666828.444055:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666828.892019:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00000040:00080000:0.0:1788666828.956810:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788666829.340221:0:22756:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788666829.340232:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9370523c9800 from 12 10000000:01000000:3.0:1788666829.340240:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788666829.340303:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666829.340317:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666829.340331:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666829.340379:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525066880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788666829.340559:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666829.340659:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525066880 00000100:00100000:1.0:1788666829.340669:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525066880 00000100:00100000:1.0:1788666829.340740:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788666829.340758:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+16:22756:x1875552525066880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666829.340776:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666829.340792:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ad1c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666829.340821:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ad1c expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666829.340822:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704a1fce40 going to sleep for 11 seconds 00010000:00010000:1.0:1788666829.340867:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad1c expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666829.340883:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040030200, rc 0) 00000100:00100000:1.0:1788666829.340929:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525066880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666829.340945:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788666829.340958:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525066880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666829.340978:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666829.340991:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666829.341513:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525067008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788666829.341601:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666829.341709:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704a1fce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666829.342394:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525067008 00000100:00100000:2.0:1788666829.342406:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525067008 00000100:00100000:2.0:1788666829.342458:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788666829.342468:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525067008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788666829.342499:0:22753:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788666829.342522:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788666829.342526:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788666829.342646:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525067008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666829.342655:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788666829.343443:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525067008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788666829.343522:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788666829.343534:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666829.343545:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666829.343556:0:22756:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788666829.343559:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff937065bbb800 from 12 10000000:01000000:1.0:1788666829.343562:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788666829.343601:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666829.343622:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666829.343632:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666829.343655:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525067136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666829.343705:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666829.343758:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f43c563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666829.343929:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525067136 00000100:00100000:2.0:1788666829.343946:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525067136 00000100:00100000:2.0:1788666829.344001:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788666829.344011:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525067136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666829.344024:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666829.344039:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ad2a expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666829.344071:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ad2a expref: 18 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666829.344083:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad2a expref: 18 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666829.344093:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a3400, rc 0) 00000100:00100000:2.0:1788666829.344138:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+18:22756:x1875552525067136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666829.344146:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788666829.344225:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525067136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666829.344241:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666829.344251:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666829.344406:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525067264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788666829.344445:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666829.344479:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f43c563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666829.344632:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525067264 00000100:00100000:2.0:1788666829.344637:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525067264 00000100:00100000:2.0:1788666829.344669:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788666829.344678:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:22756:x1875552525067264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788666829.344694:0:22752:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788666829.344712:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788666829.344715:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788666829.344791:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:22756:x1875552525067264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666829.344799:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788666829.345441:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525067264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788666829.345502:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788666829.345576:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666829.345589:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666829.469350:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666829.915979:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00000040:00080000:0.0:1788666829.982782:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788666830.493313:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666830.939904:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788666831.516864:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666831.966027:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788666832.550414:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788666832.654461:0:23759:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg634-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788666832.796963:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666832.796987:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525067392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666832.797059:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666832.797283:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525067392 00000100:00100000:0.0:1788666832.797292:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525067392 00000100:00100000:0.0:1788666832.797344:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666832.797353:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525067392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788666832.797385:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788666832.797450:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525067392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666832.797472:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788666832.797652:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525067392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666832.987958:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 0 seconds 00000100:00080000:1.0:1788666833.308150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788666833.308158:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788666833.308161:0:37:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666833.308175:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff937044125000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666833.308199:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac6680 x1875552525067648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666833.308215:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666833.308218:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666833.308221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666833.308224:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666833.308246:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666833.308249:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666833.308251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666833.308254:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788666833.308297:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525067520:0@lo:400:kworker.0 00000100:00100000:2.0:1788666833.308374:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525068032:0@lo:400:kworker.0 00000100:00100000:3.0:1788666833.308375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666833.308422:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666833.308477:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525067648:0@lo:38:kworker.0 00000100:00100000:1.0:1788666833.308489:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525067520 00000100:00100000:1.0:1788666833.308497:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525067520 00000100:00100000:3.0:1788666833.308510:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666833.308546:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525067776:0@lo:400:kworker.0 00000100:00100000:1.0:1788666833.308550:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788666833.308562:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:3641:x1875552525067520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666833.308579:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666833.308600:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788666833.308608:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525067904:0@lo:400:kworker.0 00000100:00100000:1.0:1788666833.308625:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:3641:x1875552525067520:12345-0@lo:400:kworker.0 Request processed in 64us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666833.308642:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788666833.308654:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666833.308689:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525067648 00000100:00100000:3.0:1788666833.308693:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525067648 00000100:00100000:3.0:1788666833.308722:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525067904 00000100:00100000:3.0:1788666833.308724:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525067904 00000100:00100000:3.0:1788666833.308753:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788666833.308758:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1875552525067648:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788666833.308783:0:23498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000100:00100000:1.0:1788666833.308816:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666833.308827:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525067904:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1788666833.308858:0:23498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4267b949b564ad38 00000004:00100000:3.0:1788666833.308873:0:23498:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788666833.308879:0:23498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788666833.308908:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525067904:12345-0@lo:400:kworker.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666833.308924:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788666833.308985:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525067904:0@lo:400:kworker.0 00000100:00100000:3.0:1788666833.309012:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525067520:0@lo:400:kworker.0 00000100:00100000:3.0:1788666833.309044:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525068032 00000100:00100000:3.0:1788666833.309048:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525068032 00000100:00100000:3.0:1788666833.309080:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525067776 00000100:00100000:3.0:1788666833.309083:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525067776 00000100:00100000:3.0:1788666833.309099:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788666833.309105:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525068032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666833.309140:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525068032:12345-0@lo:400:kworker.0 Request processed in 34us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666833.309145:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788666833.309158:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666833.309163:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525067776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666833.309194:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525067776:12345-0@lo:400:kworker.0 Request processed in 31us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666833.309210:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788666833.309241:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937074ac6a00 x1875552525067776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666833.309251:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525067776:0@lo:400:kworker.0 00010000:00080000:2.0:1788666833.318492:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937074ac4380 x1875552525068032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666833.318517:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525068032:0@lo:400:kworker.0 00000100:00080000:0.0:1788666833.338829:0:23498:0:(import.c:65:import_set_state_nolock()) ffff93707b51f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788666833.339087:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875552525067648:12345-0@lo:38:kworker.0 Request processed in 30325us (30575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666833.339099:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788666833.339589:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788666833.339598:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788666833.339604:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788666833.339606:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937044125000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788666833.339618:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002f761dfc): req@ffff93707f602d80 x1875552525060608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666833.339642:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525067648:0@lo:38:kworker.0 00000100:00100000:0.0:1788666833.340082:0:22800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666833.340123:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370433c10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666833.340219:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525060608 00000100:00100000:3.0:1788666833.340225:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525060608 00000100:00100000:3.0:1788666833.340466:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788666833.340476:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1875552525060608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788666833.340549:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1875552525060608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666833.340556:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666833.340667:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666833.340677:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525068160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788666833.340706:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666833.340795:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525068160 00000100:00100000:0.0:1788666833.340800:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525068160 00000100:00100000:0.0:1788666833.340831:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666833.340861:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875552525068160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788666833.341192:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788666833.341242:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875552525068160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 382us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666833.341249:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666833.341511:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525068160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788666833.341571:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1875552525060608:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788666833.341606:0:22800:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788666833.341640:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1875552525068288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788666833.341673:0:22800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666833.341733:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff93706de7e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666833.354968:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525068288 00000100:00100000:3.0:1788666833.354981:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525068288 00000100:00100000:3.0:1788666833.355025:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788666833.355033:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1875552525068288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788666833.355190:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1875552525068288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 158us (13516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666833.355207:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666833.358040:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1875552525068288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788666833.358164:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1875552525068416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788666833.358220:0:22800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666833.358253:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff93706de7e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666833.362978:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525068416 00000100:00100000:3.0:1788666833.362989:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525068416 00000100:00100000:3.0:1788666833.363037:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666833.363046:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1875552525068416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788666833.363160:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1875552525068416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (4938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666833.363168:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788666833.363892:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1875552525068416:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788666833.363961:0:22800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666833.368928:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788666833.369000:0:22800:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:0.0:1788666833.369005:0:22800:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788666833.564102:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788666833.713326:0:23811:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788666833.713530:0:23811:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788666834.427801:0:23861:0:(tgt_mount.c:2352:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788666834.428500:0:23861:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788666834.588553:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788666835.596720:0:23909:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff37c5f210 20000000:00000080:0.0:1788666835.596736:0:23909:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93704748c800 uarg=0000000000000000 20000000:01000000:0.0:1788666835.596779:0:23909:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788666835.596786:0:23909:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788666835.596791:0:23909:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788666835.602367:0:23910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788666835.603182:0:23909:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788666835.611724:0:23909:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788666835.611881:0:23909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666835.611899:0:23909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564abe1 expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666835.611919:0:23909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ace4 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666835.611926:0:23909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666835.611971:0:23909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ace4 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666835.611986:0:23909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ace4 expref: 17 pid: 22751 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666835.612000:0:23909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23909:1875552525068544:0@lo:104: 00000100:00100000:3.0:1788666835.612062:0:23909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788666835.612119:0:23909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564abe1 expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666835.612138:0:23909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564abe1 expref: 17 pid: 22752 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666835.612146:0:23909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23909:1875552525068672:0@lo:104: 00000100:00100000:3.0:1788666835.612170:0:23909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666835.612192:0:23909:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f424996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666835.612430:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525068544 00000100:00100000:1.0:1788666835.612437:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525068544 00000100:00100000:1.0:1788666835.612470:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525068672 00000100:00100000:1.0:1788666835.612472:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525068672 00000100:00100000:1.0:1788666835.612485:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666835.612492:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+4:23909:x1875552525068544:12345-0@lo:104: 00010000:00010000:1.0:1788666835.612505:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612566:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788666835.612572:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+4:23909:x1875552525068544:12345-0@lo:104: Request processed in 80us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666835.612578:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666835.612594:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788666835.612600:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:23909:x1875552525068672:12345-0@lo:104: 00010000:00010000:1.0:1788666835.612607:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612648:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788666835.612653:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:23909:x1875552525068672:12345-0@lo:104: Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666835.612660:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788666835.612735:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666835.612741:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612749:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3800 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666835.612752:0:22747:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612761:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666835.612769:0:22747:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666835.612775:0:22747:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788666835.612799:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612805:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666835.612824:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612854:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a3800/0x4267b949b564ace4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564aceb expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612878:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666835.612882:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612888:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f8a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666835.612891:0:22747:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612897:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666835.612915:0:22747:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666835.612920:0:22747:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788666835.612934:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612939:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666835.612945:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612951:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff9370582f8a00/0x4267b949b564abe1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564abe8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.612963:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666835.612965:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666835.612967:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666835.612978:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525068800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666835.613022:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666835.613050:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666835.613056:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525068928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666835.613077:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666835.613493:0:23909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23909:1875552525068544:0@lo:104: 00000100:00100000:3.0:1788666835.613502:0:23909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23909:1875552525068672:0@lo:104: 00010000:00010000:3.0:1788666835.613521:0:23909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666835.613579:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666835.616775:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666835.616804:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525068800 00000100:00100000:2.0:1788666835.616814:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525068800 00010000:00010000:2.0:1788666835.616887:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ace4 expref: 18 pid: 22751 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666835.616931:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525068928 00000100:00100000:2.0:1788666835.616935:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525068928 00010000:00010000:2.0:1788666835.616949:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564abe1 expref: 19 pid: 22752 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666835.616964:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666835.616972:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+19:3638:x1875552525068800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666835.616987:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666835.616992:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ace4 expref: 19 pid: 22751 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617004:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ace4 expref: 19 pid: 22751 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617034:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a2c00/0x4267b949b564aceb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ace4 expref: 19 pid: 22751 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617049:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666835.617122:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+18:3638:x1875552525068800:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666835.617129:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666835.617145:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666835.617152:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+17:3638:x1875552525068928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666835.617160:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666835.617164:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564abe1 expref: 17 pid: 22752 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617173:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564abe1 expref: 17 pid: 22752 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617184:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a2a00/0x4267b949b564abe8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564abe1 expref: 17 pid: 22752 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617195:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617202:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617216:0:22744:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617223:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617236:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617243:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617249:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9c00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666835.617253:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617262:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617275:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666835.617285:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666835.617311:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+16:3638:x1875552525068928:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666835.617317:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788666835.617548:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525068928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666835.617560:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525068800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666835.618178:0:23909:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666835.618189:0:23909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666835.618196:0:23909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f9c00/0x4267b949b564ad3f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666836.643063:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788666837.021324:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788666837.277910:0:22756:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788666837.277917:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9370523c9800 from 13 10000000:01000000:3.0:1788666837.277922:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788666837.277966:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666837.277980:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666837.278003:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666837.278029:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788666837.278094:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666837.278144:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f42499f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666837.278229:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525069056 00000100:00100000:0.0:1788666837.278237:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525069056 00000100:00100000:0.0:1788666837.278286:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788666837.278295:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+16:22756:x1875552525069056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666837.278310:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666837.278323:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ad46 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666837.278345:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ad46 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666837.278356:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad46 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666837.278377:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93705d3e0400, rc 0) 00000100:00100000:0.0:1788666837.278416:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525069056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666837.278423:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788666837.278471:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666837.278484:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666837.278493:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666837.278545:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666837.278566:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666837.278579:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370481a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666837.278592:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525069184 00000100:00100000:0.0:1788666837.278596:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525069184 00000100:00100000:0.0:1788666837.278635:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788666837.278643:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525069184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666837.278733:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525069184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666837.278739:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788666837.278769:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666837.278796:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666837.278830:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666837.279175:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370481a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666837.282101:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525069312 00000100:00100000:2.0:1788666837.282114:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525069312 00000100:00100000:2.0:1788666837.282163:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788666837.282173:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525069312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666837.282320:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525069312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666837.282328:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788666837.282433:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788666837.283783:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788666837.288530:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788666837.288579:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788666837.288590:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666837.288602:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666837.288613:0:22756:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788666837.288631:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff937065bbb800 from 13 10000000:01000000:2.0:1788666837.288634:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788666837.288678:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666837.288686:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666837.288695:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666837.288720:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666837.288783:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666837.288826:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704a042a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666837.289052:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525069440 00000100:00100000:3.0:1788666837.289059:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525069440 00000100:00100000:3.0:1788666837.289102:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788666837.289111:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+17:22756:x1875552525069440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666837.289123:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666837.289135:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ad54 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666837.289157:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ad54 expref: 18 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666837.289167:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad54 expref: 18 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666837.289176:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f8e00, rc 0) 00000100:00100000:3.0:1788666837.289213:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:22756:x1875552525069440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666837.289220:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788666837.289333:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666837.289347:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666837.289356:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666837.289409:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666837.289444:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666837.289469:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704a042a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666837.289509:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525069568 00000100:00100000:3.0:1788666837.289513:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525069568 00000100:00100000:3.0:1788666837.289550:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788666837.289556:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:22756:x1875552525069568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666837.289663:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:22756:x1875552525069568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666837.289669:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788666837.293357:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666837.293418:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666837.293497:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666837.293528:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704a042a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666837.293602:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525069696 00000100:00100000:3.0:1788666837.293609:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525069696 00000100:00100000:3.0:1788666837.293684:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788666837.293693:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+18:22756:x1875552525069696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666837.293800:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+18:22756:x1875552525069696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666837.293808:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788666837.294014:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525069696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788666837.294674:0:23984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788666837.294738:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788666837.294754:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788666837.294764:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666837.294774:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666837.406437:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666827/real 1788666827] req@ffff936f43763b80 x1875552525063808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666837 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666837.406467:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff936f43763b80 x1875552525063808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666837 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666837.406478:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666827/real 1788666827] req@ffff93707f601f80 x1875552525063680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666837 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666837.406489:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93707f601f80 x1875552525063680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666837 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788666837.406506:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666837.406532:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788666837.406536:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525063808:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788666837.406542:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666837.406548:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788666837.406551:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525063680:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788666837.406679:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666837.406683:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666837.406686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666837.406688:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666837.406720:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666837.406724:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788666837.406726:0:36:0:(import.c:65:import_set_state_nolock()) ffff937074b3b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666837.406731:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00080000:1.0:1788666837.406736:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788666837.406742:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff937074b3b000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666837.406758:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac4000 x1875552525070208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666837.406770:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666837.406772:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788666837.406774:0:36:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666837.406777:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00080000:1.0:1788666837.406779:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788666837.406782:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937074b3b800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666837.406806:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff937074ac7b80 x1875552525070336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666837.406861:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875552525070464:0@lo:400:kworker.0 00000100:00100000:1.0:1788666837.406929:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666837.406954:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666837.406960:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525070080:0@lo:400:kworker.0 00000100:00100000:1.0:1788666837.406985:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666837.407056:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525069952:0@lo:400:kworker.0 00000100:00100000:3.0:1788666837.407085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666837.407116:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666837.407122:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525069824:0@lo:400:kworker.0 00000100:00100000:3.0:1788666837.407143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666837.407171:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525070464 00000100:00100000:3.0:1788666837.407178:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525070464 00000100:00100000:3.0:1788666837.407218:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525069952 00000100:00100000:3.0:1788666837.407221:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525069952 00000100:00100000:3.0:1788666837.407237:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788666837.407245:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875552525070464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666837.407293:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875552525070464:12345-0@lo:400:kworker.0 Request processed in 49us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666837.407300:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788666837.407314:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666837.407328:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525069952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666837.407362:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525069952:12345-0@lo:400:kworker.0 Request processed in 35us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666837.407368:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666837.407385:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525070080 00000100:00100000:3.0:1788666837.407388:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525070080 00000100:00100000:3.0:1788666837.407406:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525069824 00000100:00100000:3.0:1788666837.407409:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525069824 00000100:00100000:3.0:1788666837.407420:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788666837.407426:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525070080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666837.407455:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525070080:12345-0@lo:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666837.407461:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788666837.407472:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666837.407478:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875552525069824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666837.407504:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875552525069824:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666837.407509:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666837.407543:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525069824:0@lo:400:kworker.0 00010000:00080000:3.0:1788666837.407554:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937074ac7800 x1875552525069952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666837.407563:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525069952:0@lo:400:kworker.0 00000100:00100000:3.0:1788666837.407595:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525070080:0@lo:400:kworker.0 00010000:00080000:3.0:1788666837.407605:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff937074ac6680 x1875552525070464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666837.407625:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875552525070464:0@lo:400:kworker.0 00000100:00100000:0.0:1788666837.407717:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525070208:0@lo:8:kworker.0 00000400:00000100:0.0:1788666837.407745:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525070208 offset 0 length 520: 4 00000100:00100000:0.0:1788666837.407774:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525070336:0@lo:8:kworker.0 00000400:00000100:0.0:1788666837.407793:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525070336 offset 0 length 520: 4 00010000:00010000:2.0:1788666837.660070:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666837.917174:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525070592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788666837.917237:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666837.917285:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525070592 00000100:00100000:1.0:1788666837.917291:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525070592 00000100:00100000:1.0:1788666837.917330:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666837.917403:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525070592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788666837.917442:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788666837.917641:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525070592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 302us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666837.917649:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666837.917695:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525070592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666838.429047:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666838.431362:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525070720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788666838.431443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666838.431632:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525070720 00000100:00100000:3.0:1788666838.431640:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525070720 00000100:00100000:3.0:1788666838.431688:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788666838.431697:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875552525070720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788666838.431729:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788666838.431785:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875552525070720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666838.431792:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788666838.431899:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525070720:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788666838.684815:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788666838.944746:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1788666839.199263:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788666839.708123:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666840.476311:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666825/real 1788666825] req@ffff937074ac5f80 x1875552525061632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666840 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666840.476355:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff937074ac5f80 x1875552525061632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666840 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666840.476367:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666825/real 1788666825] req@ffff937074ac4700 x1875552525061760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666840 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666840.476379:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff937074ac4700 x1875552525061760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666840 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788666840.476417:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f43c77800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666840.476598:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788666840.476603:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525061632:0@lo:8:kworker.0 00000100:00080000:3.0:1788666840.476610:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9370523ca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666840.476714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666840.476718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788666840.476722:0:37:0:(import.c:65:import_set_state_nolock()) ffff936f43c77800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666840.476728:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1788666840.476735:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1788666840.476748:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525070976:0@lo:400:kworker.0 00000100:00080000:0.0:1788666840.476758:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff936f43c77800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666840.476794:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93707f602a00 x1875552525071104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666840.476804:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666840.476807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788666840.476808:0:37:0:(import.c:65:import_set_state_nolock()) ffff9370523ca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666840.476811:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1788666840.476814:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788666840.476818:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9370523ca800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666840.476828:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93707f603b80 x1875552525071232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666840.476901:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666840.476906:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666840.476908:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666840.476912:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788666840.477042:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525071360:0@lo:400:kworker.0 00000100:00100000:2.0:1788666840.477048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666840.477109:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788666840.477124:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525070848:0@lo:400:kworker.0 00000100:00100000:0.0:1788666840.477134:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666840.477353:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525070976 00000100:00100000:1.0:1788666840.477364:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525070976 00000100:00100000:1.0:1788666840.477503:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788666840.477515:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525070976:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788666840.477668:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788666840.477684:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525061760:0@lo:8:kworker.0 00000100:00100000:3.0:1788666840.477718:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525071104:0@lo:8:kworker.0 00000100:00100000:0.0:1788666840.480133:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666840.480159:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525071488:0@lo:400:kworker.0 00000100:00100000:0.0:1788666840.480239:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666840.480309:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525071488 00000100:00100000:0.0:1788666840.480318:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525071488 00000100:00100000:0.0:1788666840.480367:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788666840.480377:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525071488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666840.480565:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525071488:12345-0@lo:400:kworker.0 Request processed in 188us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666840.480574:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788666840.480624:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525071488:0@lo:400:kworker.0 00000100:00100000:1.0:1788666840.481592:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525070976:12345-0@lo:400:kworker.0 Request processed in 4074us (4542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666840.481603:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788666840.481661:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666840.481666:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666840.481669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666840.481672:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000400:00000100:3.0:1788666840.484638:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525071104 offset 0 length 520: 4 00000100:00100000:3.0:1788666840.484722:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525071232:0@lo:8:kworker.0 00000400:00000100:3.0:1788666840.485020:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552525071232 offset 0 length 520: 4 00000100:00100000:3.0:1788666840.485089:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525071360 00000100:00100000:3.0:1788666840.485099:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525071360 00000100:00100000:3.0:1788666840.485217:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788666840.485230:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525071360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666840.485312:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525071360:12345-0@lo:400:kworker.0 Request processed in 84us (8178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666840.485321:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788666840.485490:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93707f600380 x1875552525071360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666840.485509:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525071360:0@lo:400:kworker.0 00000100:00100000:2.0:1788666840.487310:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666840.487477:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525070848 00000100:00100000:3.0:1788666840.487487:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525070848 00000100:00100000:1.0:1788666840.487534:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875552525071616:0@lo:400:kworker.0 00000100:00100000:3.0:1788666840.487558:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788666840.487572:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:3639:x1875552525070848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666840.487618:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666840.487684:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+18:3639:x1875552525070848:12345-0@lo:400:kworker.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666840.487684:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525071616 00000100:00100000:1.0:1788666840.487697:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525071616 00000100:00100000:3.0:1788666840.487705:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788666840.487938:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666840.487952:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875552525071616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666840.488012:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875552525071616:12345-0@lo:400:kworker.0 Request processed in 63us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666840.488020:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788666840.488074:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93707f601500 x1875552525071616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666840.488091:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875552525071616:0@lo:400:kworker.0 00000100:00100000:1.0:1788666840.488110:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525070976:0@lo:400:kworker.0 00000100:00100000:1.0:1788666840.488140:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525070848:0@lo:400:kworker.0 00010000:00010000:0.0:1788666840.732758:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788666841.661463:0:24257:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:0.0:1788666841.661467:0:24257:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788666841.661468:0:24257:0:(obd_mount.c:927:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788666841.661576:0:24257:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93707b51b800 00000020:01000004:0.0:1788666841.661591:0:24257:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788666841.661603:0:24257:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788666841.661615:0:24257:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93707b513380) 00000020:00000080:0.0:1788666841.661630:0:24257:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788666841.746123:0:24257:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788666841.746960:0:24257:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788666841.747363:0:24257:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788666841.747699:0:24257:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788666841.747911:0:24257:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788666841.748167:0:24257:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788666841.748527:0:24257:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788666841.751186:0:24257:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788666841.752650:0:24257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788666841.752665:0:24257:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788666841.752679:0:24257:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4267b949b564ad69 00000020:01000004:2.0:1788666841.752685:0:24257:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788666841.752705:0:24257:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788666841.752708:0:24257:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.206.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788666841.752714:0:24257:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788666841.752719:0:24257:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788666841.752731:0:24257:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93705101cd40) 00000020:00000080:2.0:1788666841.752741:0:24257:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788666841.754173:0:24257:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666841.754331:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788666841.754337:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788666841.759174:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788666841.759188:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00010000:00010000:2.0:1788666841.760611:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666841.761472:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788666841.761485:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788666841.767638:0:24257:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666841.767810:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788666841.767817:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788666841.769641:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788666841.769652:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788666841.786679:0:24257:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666841.787069:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788666841.787076:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788666841.788747:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788666841.788757:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788666841.789644:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788666841.789650:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788666841.793962:0:24257:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666841.794143:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788666841.794149:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788666841.800415:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788666841.800428:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788666841.829118:0:24257:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666841.829339:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788666841.829344:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788666841.837522:0:24257:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788666841.837536:0:24257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788666841.839319:0:24257:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788666841.839350:0:24257:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788666841.839357:0:24257:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788666841.859972:0:24257:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788666841.860022:0:24257:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.134@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788666841.860027:0:24257:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788666841.860028:0:24257:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788666841.860030:0:24257:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666841.860031:0:24257:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666841.860032:0:24257:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666841.860034:0:24257:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666841.860035:0:24257:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666841.860037:0:24257:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666841.860039:0:24257:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788666841.860042:0:24257:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788666841.860045:0:24257:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788666841.860046:0:24257:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788666841.860047:0:24257:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666841.860048:0:24257:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666841.860049:0:24257:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666841.860050:0:24257:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666841.860051:0:24257:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666841.860052:0:24257:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666841.860053:0:24257:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788666841.860077:0:24257:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788666841.860096:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525071744:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788666841.860161:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666841.860209:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075540 going to sleep for 11 seconds 00000100:00100000:3.0:1788666841.860345:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525071744 00000100:00100000:3.0:1788666841.860354:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525071744 00000100:00100000:3.0:1788666841.860517:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788666841.860527:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+18:24257:x1875552525071744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788666841.860557:0:22751:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788666841.860560:0:22751:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788666841.860563:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788666841.860904:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+18:24257:x1875552525071744:12345-0@lo:253:mount.lustre.0 Request processed in 378us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666841.860913:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788666841.862147:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525071744:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788666841.862161:0:24257:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788666841.862164:0:24257:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788666841.862166:0:24257:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788666841.862167:0:24257:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666841.862168:0:24257:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666841.862169:0:24257:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666841.862183:0:24257:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666841.862184:0:24257:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666841.862186:0:24257:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666841.862187:0:24257:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788666841.862208:0:24257:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93707b51b800 from lustre-OST0000 10000000:01000000:1.0:1788666841.862237:0:24257:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788666841.862240:0:24257:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788666841.862248:0:24257:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff937072250000 local copy 00010000:00010000:1.0:1788666841.862259:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666841.862373:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525071872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666841.863276:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666841.863391:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666841.863642:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525071872 00000100:00100000:2.0:1788666841.863649:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525071872 00000100:00100000:2.0:1788666841.863697:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788666841.863706:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:24257:x1875552525071872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666841.863854:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+18:24257:x1875552525071872:12345-0@lo:501:mount.lustre.0 Request processed in 129us (561us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666841.863862:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788666841.865547:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525071872:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788666841.865657:0:24257:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788666841.865697:0:24257:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788666841.865707:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.865717:0:24257:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666841.865767:0:24257:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93707b51b800 10000000:01000000:0.0:1788666841.865772:0:24257:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788666841.865778:0:24257:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788666841.865782:0:24257:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788666841.865786:0:24257:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788666841.865789:0:24257:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788666841.865821:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93705d3e1a00/0x4267b949b564ad77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.865828:0:24257:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93705d3e1a00/0x4267b949b564ad77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.865956:0:24257:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93705d3e1a00/0x4267b949b564ad77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666841.865977:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788666841.866037:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.866118:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff93707225b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666841.866262:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525072000 00000100:00100000:3.0:1788666841.866268:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525072000 00000100:00100000:3.0:1788666841.866495:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788666841.866505:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+18:24257:x1875552525072000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666841.866518:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666841.866543:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f8800/0x4267b949b564ad7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ad77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.866566:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f8800/0x4267b949b564ad7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ad77 expref: 19 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.866575:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f8800/0x4267b949b564ad7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad77 expref: 19 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.866584:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f8800, rc 0) 00000100:00100000:3.0:1788666841.866634:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+19:24257:x1875552525072000:12345-0@lo:101:mount.lustre.0 Request processed in 131us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666841.866640:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788666841.866711:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666841.866725:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93705d3e1a00/0x4267b949b564ad77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad7e expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.866733:0:24257:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93705d3e1a00/0x4267b949b564ad77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ad7e expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788666841.868001:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788666841.868629:0:24257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666841.872130:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788666841.872188:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788666841.872204:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788666841.872217:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788666841.872229:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788666841.872243:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788666841.872256:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788666841.872268:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788666841.872281:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788666841.872295:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788666841.872309:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788666841.872323:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788666841.872346:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788666841.872351:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788666841.873037:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666841.873095:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.873195:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074a503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666841.875183:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525072128 00000100:00100000:3.0:1788666841.875194:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525072128 00000100:00100000:3.0:1788666841.875249:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788666841.875259:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+19:24257:x1875552525072128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666841.875703:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+19:24257:x1875552525072128:12345-0@lo:501:mount.lustre.0 Request processed in 444us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666841.875711:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788666841.876455:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666841.876509:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666841.876572:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.876662:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074a503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666841.879218:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525072256 00000100:00100000:3.0:1788666841.879231:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525072256 00000100:00100000:3.0:1788666841.879291:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788666841.879300:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+19:24257:x1875552525072256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666841.882306:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+19:24257:x1875552525072256:12345-0@lo:503:mount.lustre.0 Request processed in 3000us (5727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.882422:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788666841.882866:0:24257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788666841.882973:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666841.883018:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.883054:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704921da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666841.883263:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525072384 00000100:00100000:2.0:1788666841.883276:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525072384 00000100:00100000:2.0:1788666841.883337:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788666841.883347:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525072384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666841.883749:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525072384:12345-0@lo:502:mount.lustre.0 Request processed in 403us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666841.883757:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788666841.883855:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788666841.884639:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666841.884913:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788666841.884943:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788666841.884959:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788666841.884989:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788666841.885007:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788666841.885021:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788666841.885035:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788666841.885047:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788666841.885058:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788666841.885070:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788666841.885082:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788666841.885095:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788666841.885126:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666841.885176:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666841.885225:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666841.888373:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525072512 00000100:00100000:2.0:1788666841.888388:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525072512 00000100:00100000:2.0:1788666841.888451:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788666841.888462:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+19:24257:x1875552525072512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666841.888619:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+19:24257:x1875552525072512:12345-0@lo:502:mount.lustre.0 Request processed in 158us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666841.888627:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788666841.888859:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666841.888948:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788666841.888963:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788666841.889626:0:24274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788666841.889634:0:24274:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788666841.889640:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666841.889643:0:24274:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788666841.889649:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666841.889663:0:24274:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9370475b0000) 00000020:00000080:1.0:1788666841.889685:0:24274:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788666841.889691:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788666841.889770:0:24274:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93707b51b800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788666841.889778:0:24274:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788666841.889784:0:24274:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4267b949b564ad8c 00010000:00010000:0.0:1788666841.896530:0:24274:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788666841.897137:0:24274:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788666841.898558:0:24274:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788666841.899933:0:24274:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788666841.899943:0:24274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666841.899949:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.899952:0:24274:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788666841.899955:0:24274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788666841.899957:0:24274:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788666841.899959:0:24274:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788666841.899960:0:24274:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788666841.899962:0:24274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788666841.899964:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.899965:0:24274:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788666841.899968:0:24274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666841.899970:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.899971:0:24274:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788666841.899974:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788666841.899976:0:24274:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788666841.899978:0:24274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666841.899980:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.899981:0:24274:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788666841.899983:0:24274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666841.899986:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.899987:0:24274:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788666841.899990:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788666841.900012:0:24274:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666841.900016:0:24274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.900017:0:24274:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788666841.900020:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788666841.901066:0:24257:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788666841.901096:0:24257:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788666841.901118:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93705d3e1a00/0x4267b949b564ad77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad7e expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666841.901130:0:24257:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93705d3e1a00/0x4267b949b564ad77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad7e expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666841.901137:0:24257:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93707b51b800 from 1 10000000:01000000:2.0:1788666841.901140:0:24257:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788666841.901172:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666841.901181:0:24257:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666841.901203:0:24257:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666841.901226:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666841.901519:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666841.901563:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4265b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788666841.901630:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525072640 00000100:00100000:3.0:1788666841.901643:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525072640 00000100:00100000:3.0:1788666841.901694:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788666841.901703:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+19:24257:x1875552525072640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666841.901715:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666841.901726:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ad93 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.901747:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ad93 expref: 20 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.901757:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad93 expref: 20 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.901765:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f9e00, rc 0) 00000100:00100000:3.0:1788666841.901800:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525072640:12345-0@lo:101:mount.lustre.0 Request processed in 98us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666841.901806:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788666841.902090:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666841.902104:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666841.902113:0:24257:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666841.903428:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788666841.903649:0:24257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666841.903812:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788666841.903956:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788666841.903975:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788666841.903988:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788666841.904001:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788666841.904014:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788666841.904116:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788666841.904133:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788666841.904146:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788666841.904160:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788666841.904173:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788666841.904192:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788666841.904197:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788666841.904257:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666841.904623:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666841.904721:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4265b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788666841.906303:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525072768 00000100:00100000:3.0:1788666841.906315:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525072768 00000100:00100000:3.0:1788666841.906372:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788666841.906381:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525072768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666841.907050:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525072768:12345-0@lo:501:mount.lustre.0 Request processed in 667us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666841.907060:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788666841.908862:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666841.908933:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666841.908999:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.909037:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788666841.911112:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525072896 00000100:00100000:3.0:1788666841.911125:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525072896 00000100:00100000:3.0:1788666841.911184:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788666841.911194:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525072896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666841.912143:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525072896:12345-0@lo:503:mount.lustre.0 Request processed in 948us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666841.912152:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788666841.912247:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525072896:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788666841.912679:0:24257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788666841.912776:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666841.912884:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666841.912921:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075240 going to sleep for 11 seconds 00000100:00100000:3.0:1788666841.912957:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525073024 00000100:00100000:3.0:1788666841.912964:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525073024 00000100:00100000:3.0:1788666841.913004:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788666841.913013:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525073024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666841.913102:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525073024:12345-0@lo:502:mount.lustre.0 Request processed in 90us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666841.913109:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788666841.913166:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666841.913328:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788666841.913353:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788666841.913381:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788666841.913393:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788666841.913404:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788666841.913414:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788666841.913425:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788666841.913435:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788666841.913452:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788666841.913463:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788666841.913473:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788666841.913491:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666841.913521:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666841.913545:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075240 going to sleep for 11 seconds 00000100:00100000:0.0:1788666841.914036:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525073152 00000100:00100000:0.0:1788666841.914049:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525073152 00000100:00100000:0.0:1788666841.914086:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788666841.914095:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525073152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666841.914190:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525073152:12345-0@lo:502:mount.lustre.0 Request processed in 97us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.914199:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788666841.914303:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666841.914432:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788666841.914442:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788666841.916626:0:24278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666841.916637:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.916640:0:24278:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788666841.916648:0:24278:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93707b51b800 00000020:00000080:0.0:1788666841.916651:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788666841.916659:0:24278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666841.916662:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.916664:0:24278:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788666841.916667:0:24278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666841.916670:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.916671:0:24278:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788666841.916676:0:24278:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93707b51b800 00000020:00000080:0.0:1788666841.916678:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788666841.916736:0:24278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666841.916739:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.916740:0:24278:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788666841.916742:0:24278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666841.916744:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.916745:0:24278:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788666841.916749:0:24278:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93707b51b800 00000020:00000080:0.0:1788666841.916750:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788666841.916765:0:24278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666841.916767:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.916768:0:24278:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788666841.916770:0:24278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666841.916772:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.916777:0:24278:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788666841.916781:0:24278:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93707b51b800 00000020:00000080:0.0:1788666841.916783:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788666841.916802:0:24278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666841.916804:0:24278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666841.916805:0:24278:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788666841.916808:0:24278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788666841.916963:0:24257:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788666841.917280:0:24257:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788666841.917304:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.917317:0:24257:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666841.917583:0:24257:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788666841.917587:0:24257:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93707b51b800 10000000:01000000:3.0:1788666841.917590:0:24257:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93707b51b800 10000000:01000000:3.0:1788666841.917594:0:24257:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788666841.917600:0:24257:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93707b51b800 from 1 10000000:01000000:3.0:1788666841.917602:0:24257:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788666841.917644:0:24257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f9000/0x4267b949b564ada1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.917655:0:24257:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370582f9000/0x4267b949b564ada1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.917666:0:24257:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370582f9000/0x4267b949b564ada1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666841.917691:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666841.917777:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666841.917826:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370481a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666841.917910:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525073280 00000100:00100000:0.0:1788666841.917917:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525073280 00000100:00100000:0.0:1788666841.917958:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788666841.917968:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+20:24257:x1875552525073280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666841.917991:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666841.918003:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93705d3e1000/0x4267b949b564ada8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ada1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.918027:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93705d3e1000/0x4267b949b564ada8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ada1 expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.918037:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93705d3e1000/0x4267b949b564ada8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ada1 expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.918046:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93705d3e1000, rc 0) 00000100:00100000:0.0:1788666841.918083:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073280:12345-0@lo:101:mount.lustre.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.918089:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788666841.918509:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666841.918526:0:24257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370582f9000/0x4267b949b564ada1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ada8 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.918538:0:24257:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370582f9000/0x4267b949b564ada1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ada8 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788666841.921122:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788666841.921414:0:24257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666841.921652:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788666841.921696:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788666841.921719:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788666841.921738:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788666841.921756:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788666841.921774:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788666841.921791:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788666841.921808:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788666841.921823:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788666841.921884:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788666841.921901:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788666841.921915:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788666841.921928:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788666841.921939:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788666841.921951:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788666841.921964:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788666841.921977:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788666841.922003:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788666841.922019:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788666841.922033:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788666841.922048:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788666841.922061:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788666841.922076:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788666841.922091:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788666841.922105:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788666841.922120:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788666841.922134:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788666841.922149:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788666841.922165:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788666841.922179:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788666841.922196:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788666841.922211:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788666841.922225:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788666841.922251:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788666841.922279:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788666841.922299:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788666841.922317:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788666841.922338:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788666841.922356:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788666841.922376:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788666841.922394:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788666841.922413:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788666841.922443:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788666841.922463:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788666841.922481:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788666841.922498:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788666841.922518:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788666841.922537:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788666841.922696:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788666841.922715:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788666841.922729:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788666841.922735:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788666841.922819:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666841.922922:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666841.922971:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370481a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788666841.926229:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525073408 00000100:00100000:0.0:1788666841.926242:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525073408 00000100:00100000:0.0:1788666841.926303:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788666841.926314:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666841.926486:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073408:12345-0@lo:501:mount.lustre.0 Request processed in 173us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.926502:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788666841.926622:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666841.926668:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666841.926714:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666841.926750:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370481a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788666841.927491:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525073536 00000100:00100000:1.0:1788666841.927499:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525073536 00000100:00100000:1.0:1788666841.927550:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788666841.927559:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666841.927675:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073536:12345-0@lo:503:mount.lustre.0 Request processed in 117us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666841.927684:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788666841.929033:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073536:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788666841.929604:0:24257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666841.929690:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666841.930323:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666841.930366:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4265b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788666841.930757:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525073664 00000100:00100000:0.0:1788666841.930765:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525073664 00000100:00100000:0.0:1788666841.930810:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788666841.930819:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666841.930968:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073664:12345-0@lo:502:mount.lustre.0 Request processed in 149us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.930976:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788666841.931003:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666841.931221:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788666841.931249:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788666841.931263:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788666841.931275:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788666841.931289:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788666841.931304:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788666841.931317:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788666841.931330:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788666841.931346:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788666841.931361:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788666841.931374:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788666841.931390:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788666841.931405:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788666841.931421:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788666841.931446:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788666841.931457:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788666841.931468:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788666841.931480:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788666841.931492:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788666841.931508:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788666841.931522:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788666841.931546:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788666841.931558:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788666841.931571:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788666841.931583:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788666841.931597:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788666841.931610:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788666841.931621:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788666841.931636:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788666841.931653:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788666841.931680:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788666841.931696:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788666841.931711:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788666841.931723:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788666841.931737:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788666841.931750:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788666841.931763:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788666841.931775:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788666841.931787:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788666841.931798:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788666841.931809:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788666841.931820:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788666841.931855:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788666841.931883:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788666841.932031:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788666841.932052:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788666841.932067:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788666841.932083:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788666841.932125:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666841.932175:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666841.932208:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704df4fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666841.932260:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525073792 00000100:00100000:2.0:1788666841.932265:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525073792 00000100:00100000:2.0:1788666841.932306:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788666841.932386:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666841.932559:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073792:12345-0@lo:502:mount.lustre.0 Request processed in 245us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666841.932567:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788666841.932646:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666841.932781:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788666841.932803:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788666841.932823:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666841.932896:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666841.932917:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074bd4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788666841.932918:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525073920 00000100:00100000:0.0:1788666841.932922:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525073920 00000100:00100000:0.0:1788666841.932950:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788666841.932957:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666841.933043:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525073920:12345-0@lo:502:mount.lustre.0 Request processed in 86us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.933049:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788666841.935133:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525073920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666841.935231:0:24257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788666841.935243:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788666841.946478:0:24283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788666841.946495:0:24283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93707b5119c0) 00000020:00000080:0.0:1788666841.946531:0:24283:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788666841.946611:0:24283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93707b51b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788666841.946615:0:24283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93707b51b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788666841.946617:0:24283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93707b51b800 3 00010000:00080000:0.0:1788666841.946645:0:24283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff936f444a8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.134@tcp at head 00010000:00010000:0.0:1788666841.948940:0:24283:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788666841.951669:0:24283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788666841.951712:0:24283:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788666841.951723:0:24283:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4267b949b564adb6 00000100:00080000:0.0:1788666841.951733:0:24283:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788666841.951744:0:24283:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff936f444a8000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:0.0:1788666841.951775:0:24283:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43fa1500 x1875552525074048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666841.951795:0:24283:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788666841.951859:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666841.951863:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666841.951866:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666841.951878:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666841.951903:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666841.951906:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666841.951908:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666841.951910:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788666841.951940:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525074176:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.951998:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.952030:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666841.952035:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875552525074560:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.952062:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.952108:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525074176 00000100:00100000:0.0:1788666841.952115:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525074176 00000100:00100000:0.0:1788666841.952153:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666841.952160:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525074176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.952208:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525074176:12345-0@lo:400:kworker.0 Request processed in 49us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.952222:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666841.952261:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525074176:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.952911:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525074432:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.952941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.952964:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666841.952969:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525074304:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.952989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.953027:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875552525074048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788666841.953055:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.953105:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525074560 00000100:00100000:0.0:1788666841.953110:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525074560 00000100:00100000:0.0:1788666841.953131:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525074304 00000100:00100000:0.0:1788666841.953134:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525074304 00000100:00100000:0.0:1788666841.953143:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525074048 00000100:00100000:0.0:1788666841.953145:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525074048 00000100:00100000:0.0:1788666841.953155:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666841.953161:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875552525074560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.953197:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875552525074560:12345-0@lo:400:kworker.0 Request processed in 37us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.953204:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666841.953217:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666841.953222:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525074304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.953247:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525074304:12345-0@lo:400:kworker.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.953252:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666841.953269:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788666841.953272:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875552525074048:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788666841.953292:0:22759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:0.0:1788666841.953331:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4267b949b564adbd 00000004:00100000:0.0:1788666841.953345:0:22759:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788666841.953374:0:22759:0:(import.c:65:import_set_state_nolock()) ffff936f444af800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788666841.953410:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875552525074048:12345-0@lo:38:llog_process_th.0 Request processed in 135us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.953416:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788666841.953449:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff936f43fa1500 x1875552525074048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666841.953459:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788666841.953465:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788666841.953471:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788666841.953475:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788666841.953477:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f444a8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788666841.953483:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875552525074048:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788666841.953509:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff936f43fa2d80 x1875552525074304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666841.953517:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525074304:0@lo:400:kworker.0 00010000:00080000:0.0:1788666841.953539:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff936f43fa3800 x1875552525074560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666841.953548:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875552525074560:0@lo:400:kworker.0 00000100:00100000:1.0:1788666841.955327:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525074432 00000100:00100000:1.0:1788666841.955338:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525074432 00000100:00100000:1.0:1788666841.955387:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788666841.955397:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525074432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666841.955472:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525074432:12345-0@lo:400:kworker.0 Request processed in 77us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666841.955479:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788666841.958941:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525074432:0@lo:400:kworker.0 00000020:01000004:3.0:1788666841.961465:0:24283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788666841.961482:0:24283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93706f014d40) 00000020:00000080:3.0:1788666841.961505:0:24283:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788666841.961600:0:24283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93707b51b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788666841.961605:0:24283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93707b51b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788666841.961607:0:24283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93707b51b800 3 00010000:00080000:3.0:1788666841.961649:0:24283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff936f435cf000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.134@tcp at head 00010000:00010000:3.0:1788666841.963307:0:24283:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788666841.963486:0:24283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788666841.963524:0:24283:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788666841.963535:0:24283:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4267b949b564adcb 00000100:00080000:3.0:1788666841.963544:0:24283:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788666841.963550:0:24283:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff936f435cf000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:3.0:1788666841.963579:0:24283:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43761180 x1875552525074688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788666841.963601:0:24283:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788666841.963805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666841.963809:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666841.963812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666841.963815:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666841.963828:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666841.963830:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666841.963850:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666841.963853:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788666841.963893:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525075200:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.963955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.963983:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788666841.963989:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525074816:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.964046:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525075328:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964068:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.964095:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525075200 00000100:00100000:0.0:1788666841.964101:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525075200 00000100:00100000:0.0:1788666841.964131:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788666841.964139:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525075200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964183:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525075200:12345-0@lo:400:kworker.0 Request processed in 45us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.964190:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788666841.964208:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525074816 00000100:00100000:0.0:1788666841.964219:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525074816 00000100:00100000:0.0:1788666841.964240:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788666841.964245:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:3638:x1875552525074816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964270:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:3638:x1875552525074816:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.964276:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788666841.964311:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525074816:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964321:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525075200:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964345:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875552525074688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788666841.964383:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.964416:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525075328 00000100:00100000:0.0:1788666841.964420:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525075328 00000100:00100000:0.0:1788666841.964438:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525074688 00000100:00100000:0.0:1788666841.964440:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525074688 00000100:00100000:0.0:1788666841.964449:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788666841.964455:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525075328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964487:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525075328:12345-0@lo:400:kworker.0 Request processed in 32us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.964492:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788666841.964504:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788666841.964508:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875552525074688:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788666841.964528:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:0.0:1788666841.964554:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4267b949b564add2 00000004:00100000:0.0:1788666841.964566:0:22760:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788666841.964591:0:22760:0:(import.c:65:import_set_state_nolock()) ffff936f444aa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788666841.964628:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875552525074688:12345-0@lo:38:llog_process_th.0 Request processed in 119us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.964634:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788666841.964656:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff936f43fa0380 x1875552525075328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666841.964666:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525075328:0@lo:400:kworker.0 00010000:00080000:0.0:1788666841.964684:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff936f43761180 x1875552525074688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666841.964692:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788666841.964697:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788666841.964703:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788666841.964707:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788666841.964709:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f435cf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788666841.964713:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875552525074688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788666841.964728:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525075072:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.964764:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788666841.964769:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525074944:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964787:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.964800:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875552525075456:0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964816:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.964829:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525075072 00000100:00100000:0.0:1788666841.964851:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525075072 00000100:00100000:0.0:1788666841.964866:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525075456 00000100:00100000:0.0:1788666841.964880:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525075456 00000100:00100000:0.0:1788666841.964911:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788666841.964916:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525075072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964945:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525075072:12345-0@lo:400:kworker.0 Request processed in 29us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.964951:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788666841.964961:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788666841.964966:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875552525075456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.964989:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875552525075456:12345-0@lo:400:kworker.0 Request processed in 22us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.964994:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788666841.965019:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666841.965029:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525074944 00000100:00100000:0.0:1788666841.965031:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525074944 00000100:00100000:0.0:1788666841.965050:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666841.965055:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525074944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666841.965093:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525074944:12345-0@lo:400:kworker.0 Request processed in 36us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666841.965098:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666841.965122:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525074944:0@lo:400:kworker.0 00010000:00080000:0.0:1788666841.965132:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff936f43fa1c00 x1875552525075456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666841.965139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875552525075456:0@lo:400:kworker.0 00010000:00080000:0.0:1788666841.965147:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff936f43fa2d80 x1875552525075072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666841.965154:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525075072:0@lo:400:kworker.0 00000040:00080000:2.0:1788666841.968104:0:24283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788666841.968297:0:24257:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788666841.968327:0:24257:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788666841.968619:0:24257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370582f9000/0x4267b949b564ada1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ada8 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.968632:0:24257:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370582f9000/0x4267b949b564ada1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ada8 expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788666841.968685:0:24257:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788666841.968687:0:24257:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788666841.968689:0:24257:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666841.968690:0:24257:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666841.968691:0:24257:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666841.968693:0:24257:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666841.968694:0:24257:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666841.968697:0:24257:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666841.968698:0:24257:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666841.968701:0:24257:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788666841.968703:0:24257:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666841.968705:0:24257:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788666841.968706:0:24257:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666841.968707:0:24257:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666841.968708:0:24257:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666841.968709:0:24257:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666841.968710:0:24257:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666841.968711:0:24257:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666841.968712:0:24257:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666841.968735:0:24257:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788666841.968754:0:24257:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525075584:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788666841.968813:0:24257:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666841.968887:0:24257:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074bd49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666841.970346:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525075584 00000100:00100000:2.0:1788666841.970358:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525075584 00000100:00100000:2.0:1788666841.970401:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788666841.970411:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525075584:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788666841.970439:0:22751:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788666841.970452:0:22751:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788666841.981961:0:22751:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788666841.981982:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788666841.982001:0:22774:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788666841.982008:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788666841.982029:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.982048:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad1c expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.982057:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad2a expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.982078:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.982116:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ad2a expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.982129:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ad2a expref: 21 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666841.982143:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525075712:0@lo:104: 00000100:00100000:3.0:1788666841.982202:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788666841.982263:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ad1c expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.982284:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ad1c expref: 21 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666841.982291:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:24257:x1875552525075584:12345-0@lo:253:mount.lustre.0 Request processed in 11878us (13473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666841.982299:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525075840:0@lo:104: 00000100:00100000:0.0:1788666841.982304:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788666841.982305:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525075712 00000100:00100000:1.0:1788666841.982312:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525075712 00000100:00100000:3.0:1788666841.982333:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666841.982359:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525075840 00000100:00100000:1.0:1788666841.982360:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788666841.982361:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074bd4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666841.982363:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525075840 00000100:00100000:1.0:1788666841.982373:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788666841.982382:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+4:22774:x1875552525075712:12345-0@lo:104: 00010000:00010000:1.0:1788666841.982395:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.982465:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788666841.982471:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+4:22774:x1875552525075712:12345-0@lo:104: Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666841.982478:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666841.982494:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525075712:0@lo:104: 00000100:00100000:1.0:1788666841.982497:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788666841.982508:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4329f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525075840:12345-0@lo:104: 00010000:00010000:1.0:1788666841.982516:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.982533:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666841.982538:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.982546:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788666841.982550:0:22747:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.982559:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788666841.982559:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666841.982564:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4329f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525075840:12345-0@lo:104: Request processed in 58us (232us total) trans 0 rc 0/0 10000000:00010000:0.0:1788666841.982566:0:22747:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666841.982569:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:0.0:1788666841.982572:0:22747:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788666841.982598:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666841.982604:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43760000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525075840:0@lo:104: 00010000:00010000:1.0:1788666841.982605:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666841.982607:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666841.982627:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666841.982630:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788666841.982633:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666841.982635:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff937040031a00/0x4267b949b564ad2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666841.982642:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525075968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666841.982655:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666841.982657:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666841.982659:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666841.982669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666841.982701:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525075968 00000100:00100000:1.0:1788666841.982705:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525075968 00010000:00010000:1.0:1788666841.982721:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad2a expref: 21 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666841.982749:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788666841.982756:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+21:3640:x1875552525075968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666841.982764:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666841.982768:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad2a expref: 21 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.982783:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ad2a expref: 21 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.982794:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a3400/0x4267b949b564ad31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ad2a expref: 21 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.982806:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666841.982863:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+20:3640:x1875552525075968:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666841.982881:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788666841.983011:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666841.983014:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666841.983017:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666841.983051:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525075968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666841.983053:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983062:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f8200 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666841.983065:0:22746:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983072:0:22746:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666841.983079:0:22746:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666841.983085:0:22746:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788666841.983108:0:22746:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983114:0:22746:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666841.983138:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983151:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff9370582f8200/0x4267b949b564ad1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983164:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666841.983167:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525076096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666841.983167:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666841.983170:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666841.983201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666841.983247:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525076096 00000100:00100000:1.0:1788666841.983252:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525076096 00010000:00010000:1.0:1788666841.983266:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad1c expref: 20 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666841.983293:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788666841.983300:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4301c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a62c9863-c7b0-471d-812b-42670ca06572+20:3638:x1875552525076096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666841.983309:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666841.983324:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad1c expref: 20 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983334:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ad1c expref: 20 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983345:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937040030200/0x4267b949b564ad23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ad1c expref: 20 pid: 22751 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983355:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983362:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788666841.983385:0:22743:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015034990s 00010000:00010000:1.0:1788666841.983389:0:22743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983397:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983404:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983412:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983418:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666841.983422:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983430:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983459:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666841.983469:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666841.983508:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4301c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a62c9863-c7b0-471d-812b-42670ca06572+19:3638:x1875552525076096:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666841.983515:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788666841.983584:0:22774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666841.983593:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666841.983600:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525076096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666841.983602:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f9a00/0x4267b949b564add9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666841.983781:0:24257:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:24257:1875552525075584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788666841.983793:0:24257:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788666841.983797:0:24257:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788666841.983799:0:24257:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788666841.983800:0:24257:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666841.983801:0:24257:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666841.983802:0:24257:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666841.983803:0:24257:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666841.983805:0:24257:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788666841.983807:0:24257:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666841.983808:0:24257:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788666841.983819:0:24257:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788666841.985731:0:24257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788666841.988337:0:24257:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788666841.988345:0:24257:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788666841.988377:0:24257:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788666841.988412:0:24257:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788666841.988430:0:24257:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788666841.988446:0:24257:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788666841.989396:0:24257:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788666841.989755:0:24257:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788666842.774811:0:24338:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788666842.775395:0:24338:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788666842.781772:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666843.036320:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525076224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666843.036419:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666843.036495:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525076224 00000100:00100000:3.0:1788666843.036504:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525076224 00000100:00100000:3.0:1788666843.036560:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788666843.036570:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525076224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788666843.036615:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788666843.036674:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525076224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666843.036683:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788666843.036740:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525076224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788666843.550100:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666843.550122:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525076352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788666843.550189:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666843.550271:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525076352 00000100:00100000:1.0:1788666843.550286:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525076352 00000100:00100000:1.0:1788666843.551493:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788666843.551507:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525076352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788666843.551544:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788666843.551619:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525076352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666843.551626:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788666843.551714:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525076352:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1788666843.679303:0:22756:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788666843.679312:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9370523c9800 from 13 10000000:01000000:2.0:1788666843.679317:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788666843.679361:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.679374:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.679385:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666843.679408:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525076480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666843.679473:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666843.679517:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075240 going to sleep for 11 seconds 00000100:00100000:3.0:1788666843.679589:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525076480 00000100:00100000:3.0:1788666843.679603:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525076480 00000100:00100000:3.0:1788666843.679689:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788666843.679701:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+19:22756:x1875552525076480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666843.679720:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666843.679751:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ade0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666843.679782:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ade0 expref: 20 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666843.679794:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ade0 expref: 20 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666843.679805:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f9a00, rc 0) 00000100:00100000:3.0:1788666843.679916:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+20:22756:x1875552525076480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666843.679926:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788666843.679957:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525076480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666843.679980:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.679991:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666843.680042:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525076608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788666843.680077:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666843.680115:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075240 going to sleep for 11 seconds 00000100:00100000:3.0:1788666843.680169:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525076608 00000100:00100000:3.0:1788666843.680175:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525076608 00000100:00100000:3.0:1788666843.680230:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788666843.680239:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+20:22756:x1875552525076608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788666843.680257:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788666843.680271:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788666843.680274:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788666843.680354:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+20:22756:x1875552525076608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666843.680361:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788666843.680565:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525076608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788666843.680620:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788666843.680627:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.680635:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666843.680649:0:22756:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788666843.680651:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff937065bbb800 from 13 10000000:01000000:2.0:1788666843.680653:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788666843.680671:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.680679:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.680686:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666843.680698:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525076736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666843.680722:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666843.680757:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075240 going to sleep for 11 seconds 00000100:00100000:2.0:1788666843.680769:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525076736 00000100:00100000:2.0:1788666843.680772:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525076736 00000100:00100000:2.0:1788666843.680796:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788666843.680803:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+20:22756:x1875552525076736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666843.680811:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666843.680822:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564adee expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.680952:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564adee expref: 21 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.680963:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564adee expref: 21 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.680981:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93706f7a3800, rc 0) 00000100:00100000:2.0:1788666843.681013:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525076736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666843.681018:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788666843.681047:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525076736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666843.681056:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.681063:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666843.681096:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525076864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788666843.681122:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666843.681134:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075240 going to sleep for 11 seconds 00000100:00100000:2.0:1788666843.681145:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525076864 00000100:00100000:2.0:1788666843.681148:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525076864 00000100:00100000:2.0:1788666843.681169:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788666843.681175:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525076864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788666843.681184:0:22753:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788666843.681196:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788666843.681198:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788666843.681271:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525076864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666843.681278:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788666843.681303:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525076864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788666843.681342:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788666843.681347:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666843.681354:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666843.804073:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666844.828774:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666845.851946:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666846.876156:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788666847.132546:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666847.132554:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666847.132557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666847.132560:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666847.132576:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666847.132579:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666847.132581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666847.132584:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788666847.132633:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525077376:0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.133106:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666847.133151:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788666847.133158:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525076992:0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.133188:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666847.133221:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525077376 00000100:00100000:1.0:1788666847.133225:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525077504:0@lo:400:kworker.0 00000100:00100000:3.0:1788666847.133230:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525077376 00000100:00100000:1.0:1788666847.133256:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666847.133280:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788666847.133292:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525077376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.133305:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525077120:0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.133344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666847.133373:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525077376:12345-0@lo:400:kworker.0 Request processed in 73us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666847.133382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525077632:0@lo:400:kworker.0 00000100:00100000:3.0:1788666847.133396:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788666847.133414:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525077120 00000100:00100000:3.0:1788666847.133417:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525077120 00000100:00100000:1.0:1788666847.133422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666847.133439:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788666847.133447:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525077120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.133448:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666847.133458:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525077248:0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.133485:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666847.133555:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525077120:12345-0@lo:400:kworker.0 Request processed in 109us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666847.133561:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788666847.133890:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525077760:0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.133920:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666847.133999:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525077504 00000100:00100000:0.0:1788666847.134004:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525077504 00000100:00100000:0.0:1788666847.134023:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525077632 00000100:00100000:0.0:1788666847.134026:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525077632 00000100:00100000:0.0:1788666847.134046:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525077248 00000100:00100000:0.0:1788666847.134049:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525077248 00000100:00100000:0.0:1788666847.134059:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525077760 00000100:00100000:0.0:1788666847.134061:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525077760 00000100:00100000:0.0:1788666847.134075:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666847.134082:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525077504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666847.134116:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525077504:12345-0@lo:400:kworker.0 Request processed in 35us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666847.134122:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666847.134134:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666847.134140:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525077632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666847.134166:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525077632:12345-0@lo:400:kworker.0 Request processed in 27us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666847.134179:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666847.134191:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788666847.134196:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525077248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666847.134225:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525077248:12345-0@lo:400:kworker.0 Request processed in 29us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666847.134230:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788666847.134241:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788666847.134246:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525077760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666847.134269:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525077760:12345-0@lo:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666847.134275:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666847.134301:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525077120:0@lo:400:kworker.0 00010000:00080000:1.0:1788666847.134322:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937074ac7480 x1875552525077632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666847.134332:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525077632:0@lo:400:kworker.0 00000100:00080000:2.0:1788666847.134341:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788666847.134347:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788666847.134358:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937074ac4e00 x1875552525077248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666847.134368:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525077248:0@lo:400:kworker.0 00010000:00080000:1.0:1788666847.134377:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937074ac5c00 x1875552525077760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666847.134385:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525077760:0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.134413:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525076992 00000100:00100000:1.0:1788666847.134418:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525076992 00000100:00100000:1.0:1788666847.134601:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788666847.134610:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:3640:x1875552525076992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666847.134677:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:3640:x1875552525076992:12345-0@lo:400:kworker.0 Request processed in 58us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666847.134685:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788666847.135980:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525076992:0@lo:400:kworker.0 00010000:00080000:0.0:1788666847.135999:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff937074ac5880 x1875552525077504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666847.136009:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525077504:0@lo:400:kworker.0 00000100:00100000:0.0:1788666847.136021:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525077376:0@lo:400:kworker.0 00000001:02000400:1.0:1788666847.205527:0:24630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg634-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788666847.269869:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788666847.901013:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788666847.931399:0:24682:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788666847.931624:0:24682:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788666848.165876:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525077888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666848.165945:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666848.166606:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525077888 00000100:00100000:3.0:1788666848.166614:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525077888 00000100:00100000:3.0:1788666848.166669:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788666848.166678:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525077888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788666848.166707:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788666848.167026:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525077888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 348us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666848.167034:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788666848.167078:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525077888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666848.668664:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525078016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788666848.668729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666848.668791:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525078016 00000100:00100000:2.0:1788666848.668798:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525078016 00000100:00100000:2.0:1788666848.668870:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788666848.668880:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525078016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788666848.668924:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788666848.676265:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525078016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7379us (7528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666848.676278:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788666848.680547:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525078016:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1788666848.756639:0:24732:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788666848.756980:0:24732:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788666848.924172:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788666849.438016:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788666849.948090:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666850.973519:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666851.996339:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666852.194992:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666837/real 1788666837] req@ffff937074ac4000 x1875552525070208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666852 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666852.195021:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff937074ac4000 x1875552525070208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666852 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666852.195031:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666837/real 1788666837] req@ffff937074ac7b80 x1875552525070336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666852 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666852.195043:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff937074ac7b80 x1875552525070336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666852 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788666852.195061:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788666852.195081:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788666852.195086:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525070208:0@lo:8:kworker.0 00000100:00080000:1.0:1788666852.195091:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788666852.195096:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788666852.195099:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525070336:0@lo:8:kworker.0 00000100:00080000:3.0:1788666852.195173:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666852.195177:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788666852.195180:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666852.195183:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788666852.195212:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666852.195214:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788666852.195217:0:37:0:(import.c:65:import_set_state_nolock()) ffff937074b3b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788666852.195221:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1788666852.195226:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788666852.195232:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff937074b3b000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:3.0:1788666852.195248:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43761500 x1875552525078656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788666852.195259:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666852.195262:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788666852.195263:0:37:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788666852.195266:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1788666852.195269:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788666852.195272:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937074b3b800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:3.0:1788666852.195282:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f43763800 x1875552525078784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788666852.195321:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525078400:0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.195357:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525078272:0@lo:400:kworker.0 00000100:00100000:3.0:1788666852.195378:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666852.195383:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666852.195425:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875552525079168:0@lo:400:kworker.0 00000100:00100000:1.0:1788666852.195430:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525078144:0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.197885:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875552525079040:0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.197959:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666852.198012:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525078272 00000100:00100000:2.0:1788666852.198019:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525078272 00000100:00100000:2.0:1788666852.198057:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788666852.198064:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525078272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.198114:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525078272:12345-0@lo:400:kworker.0 Request processed in 51us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666852.198138:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788666852.198163:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525078400 00000100:00100000:2.0:1788666852.198167:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525078400 00000100:00100000:2.0:1788666852.198191:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525079040 00000100:00100000:2.0:1788666852.198194:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525079040 00000100:00100000:2.0:1788666852.198215:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788666852.198221:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525078400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.198253:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525078400:12345-0@lo:400:kworker.0 Request processed in 32us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666852.198272:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788666852.198284:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788666852.198290:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875552525079040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.198313:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875552525079040:12345-0@lo:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666852.198318:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788666852.198336:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666852.198362:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525078272:0@lo:400:kworker.0 00010000:00080000:2.0:1788666852.198374:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f427f1180 x1875552525079040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666852.198383:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875552525079040:0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.199447:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525078528:0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.199493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666852.199533:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525078656:0@lo:8:kworker.0 00000100:00100000:2.0:1788666852.199564:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666852.199603:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525078784:0@lo:8:kworker.0 00000100:00100000:2.0:1788666852.199630:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666852.199667:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525078528 00000100:00100000:2.0:1788666852.199673:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525078528 00000100:00100000:2.0:1788666852.199705:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788666852.199712:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525078528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.199755:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525078528:12345-0@lo:400:kworker.0 Request processed in 44us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666852.199762:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788666852.199797:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525078528:0@lo:400:kworker.0 00000100:00100000:2.0:1788666852.199860:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525078656 00000100:00100000:2.0:1788666852.199864:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525078656 00000100:00100000:2.0:1788666852.199879:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525078784 00000100:00100000:2.0:1788666852.199882:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525078784 00000100:00100000:2.0:1788666852.199891:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666852.199895:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875552525078656:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788666852.199935:0:24261:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:2.0:1788666852.199962:0:24261:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4267b949b564adfc 00002000:00100000:2.0:1788666852.199974:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff936f4216b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788666852.199978:0:24261:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788666852.199981:0:24261:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788666852.200144:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788666852.200167:0:24261:0:(import.c:65:import_set_state_nolock()) ffff936f4216f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666852.200205:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875552525078656:12345-0@lo:8:kworker.0 Request processed in 308us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666852.200211:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666852.200223:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666852.200234:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875552525078784:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788666852.200246:0:24261:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788666852.201098:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788666852.201226:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f43761c00 x1875552525078400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666852.201240:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525078400:0@lo:400:kworker.0 00000100:00100000:3.0:1788666852.201279:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525079168 00000100:00100000:3.0:1788666852.201292:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525079168 00000100:00100000:3.0:1788666852.201334:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788666852.201342:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875552525079168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666852.201385:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875552525079168:12345-0@lo:400:kworker.0 Request processed in 44us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666852.201392:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788666852.201411:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788666852.201431:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f427f0700 x1875552525079168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666852.201441:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875552525079168:0@lo:400:kworker.0 00000100:00100000:1.0:1788666852.203614:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666852.203693:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525078912:0@lo:400:kworker.0 00000100:00100000:1.0:1788666852.203733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666852.203781:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525078912 00000100:00100000:1.0:1788666852.203788:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525078912 00000100:00100000:1.0:1788666852.203861:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788666852.203869:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525078912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666852.203925:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525078912:12345-0@lo:400:kworker.0 Request processed in 56us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666852.203931:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788666852.203967:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f43761180 x1875552525078912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666852.203980:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525078912:0@lo:400:kworker.0 00000100:00100000:3.0:1788666852.205439:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525078144 00000100:00100000:3.0:1788666852.205450:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525078144 00000100:00100000:3.0:1788666852.205502:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788666852.205511:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:3638:x1875552525078144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666852.205581:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:3638:x1875552525078144:12345-0@lo:400:kworker.0 Request processed in 71us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666852.205588:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788666852.205930:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525078144:0@lo:400:kworker.0 00010000:00080000:3.0:1788666852.206146:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f43761500 x1875552525078656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788666872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666852.206157:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788666852.206165:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788666852.206172:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788666852.206177:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788666852.206180:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788666852.206207:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788666852.206213:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525078656:0@lo:8:kworker.0 00000004:00080000:0.0:1788666852.207028:0:23499:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788666852.207111:0:23499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675250275684ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788666852.207117:0:23499:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788666852.208053:0:23500:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788666852.208059:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525079296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788666852.208072:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875552525079424:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788666852.208115:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666852.208127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666852.208142:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074a506c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666852.208161:0:24263:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788666852.208165:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525079296 00000100:00100000:1.0:1788666852.208167:0:24263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788666852.208171:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525079296 00000100:00100000:3.0:1788666852.208217:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666852.208225:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875552525079296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788666852.208253:0:24265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788666852.208312:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875552525079296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666852.208319:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788666852.208338:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788666852.208533:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e6a00 x1875552525079296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666852.208551:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525079296:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788666852.208852:0:23490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788666852.210606:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525079424 00000100:00100000:1.0:1788666852.210618:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525079424 00000100:00100000:3.0:1788666852.211054:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788666852.211065:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23500:x1875552525079424:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1788666852.225177:0:24938:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788666852.225185:0:24938:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788666852.225343:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23500:x1875552525079424:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14276us (17223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666852.225353:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788666852.227290:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e5500 x1875552525079424/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788666868 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666852.227308:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875552525079424:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788666852.227323:0:23500:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788666852.227373:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875552525079552:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788666852.227424:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666852.227456:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666852.232133:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525079552 00000100:00100000:1.0:1788666852.232149:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525079552 00000100:00100000:1.0:1788666852.232219:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666852.232229:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23500:x1875552525079552:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788666852.232265:0:24263:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788666852.232350:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23500:x1875552525079552:12345-0@lo:5:osp-pre-0-1.0 Request processed in 124us (4925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666852.232357:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788666852.232705:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f427f1500 x1875552525079552/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666868 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666852.232721:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875552525079552:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788666852.232749:0:23500:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788666852.232792:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875552525079680:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788666852.232869:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666852.232895:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066aad240 going to sleep for 11 seconds 00000100:00100000:3.0:1788666852.232908:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525079680 00000100:00100000:3.0:1788666852.232912:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525079680 00000100:00100000:3.0:1788666852.232951:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788666852.232958:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23500:x1875552525079680:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788666852.232985:0:24938:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788666852.240375:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875552525078784:12345-0@lo:8:kworker.0 Request processed in 40132us (40736us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788666852.240388:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788666852.240443:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666852.240448:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788666852.240452:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525078784:0@lo:8:kworker.0 00000001:00080000:2.0:1788666852.279381:0:24258:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788666852.279396:0:24258:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788666852.280205:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23500:x1875552525079680:12345-0@lo:5:osp-pre-0-1.0 Request processed in 47239us (47328us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788666852.280221:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788666852.280382:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f427f1500 x1875552525079680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666868 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666852.280395:0:23500:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788666852.280459:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875552525079680:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788666852.280475:0:23500:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788666852.280526:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23500:1875552525079808:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788666852.280563:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666852.280631:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042da8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788666852.281344:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525079808 00000100:00100000:0.0:1788666852.281353:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525079808 00000100:00100000:0.0:1788666852.281482:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788666852.281492:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1875552525079808:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788666852.281565:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1875552525079808:12345-0@lo:900:osp-pre-0-1.0 Request processed in 75us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666852.281573:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788666852.281635:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f43fe3480 x1875552525079808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788666868 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666852.281648:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23500:1875552525079808:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788666853.020035:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666853.276251:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666853.276295:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525079936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788666853.276394:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666853.276631:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525079936 00000100:00100000:3.0:1788666853.276642:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525079936 00000100:00100000:3.0:1788666853.276738:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788666853.276750:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525079936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788666853.276793:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788666853.276896:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525079936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666853.276904:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788666853.281008:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525079936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666853.788535:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525080064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788666853.788601:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666853.789311:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525080064 00000100:00100000:1.0:1788666853.789320:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525080064 00000100:00100000:1.0:1788666853.789504:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788666853.789518:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525080064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788666853.789553:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788666853.789731:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525080064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788666853.789748:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525080064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666853.789756:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788666854.045041:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788666854.553357:0:25078:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:0.0:1788666854.553360:0:25078:0:(obd_mount.c:924:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788666854.553361:0:25078:0:(obd_mount.c:927:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788666854.554192:0:25078:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93706ed88000 00000020:01000004:0.0:1788666854.554206:0:25078:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788666854.554220:0:25078:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788666854.554232:0:25078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93707c60cd40) 00000020:00000080:0.0:1788666854.554246:0:25078:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788666854.603552:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788666854.606678:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788666854.607117:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788666854.607350:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788666854.607558:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788666854.607725:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788666854.608003:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788666854.611377:0:25078:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788666854.611591:0:25078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788666854.611605:0:25078:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788666854.611618:0:25078:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4267b949b564ae0a 00000020:01000004:2.0:1788666854.611624:0:25078:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788666854.611645:0:25078:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788666854.611648:0:25078:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.206.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788666854.611654:0:25078:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788666854.611682:0:25078:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788666854.611686:0:25078:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788666854.625178:0:25078:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788666854.625216:0:25078:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.134@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788666854.625220:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788666854.625221:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788666854.625223:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666854.625228:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666854.625229:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666854.625230:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666854.625231:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666854.625233:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666854.625234:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788666854.625237:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788666854.625240:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788666854.625241:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788666854.625242:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666854.625243:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666854.625244:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666854.625299:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666854.625302:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666854.625303:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666854.625304:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788666854.625342:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788666854.625361:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788666854.625426:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.625514:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff937049622f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666854.625550:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525080192 00000100:00100000:2.0:1788666854.625557:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525080192 00000100:00100000:2.0:1788666854.625636:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788666854.625646:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:25078:x1875552525080192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788666854.625678:0:22753:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788666854.625681:0:22753:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788666854.625684:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788666854.625986:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:25078:x1875552525080192:12345-0@lo:253:mount.lustre.0 Request processed in 340us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666854.625994:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788666854.626084:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788666854.626094:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788666854.626096:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788666854.626098:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788666854.626099:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666854.626100:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666854.626101:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666854.626103:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666854.626104:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788666854.626105:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666854.626106:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788666854.626124:0:25078:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93706ed88000 from lustre-OST0001 10000000:01000000:0.0:1788666854.626154:0:25078:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788666854.626157:0:25078:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788666854.626166:0:25078:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff937072250000 local copy 00010000:00010000:0.0:1788666854.626175:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666854.626267:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666854.626296:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.626474:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.626562:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525080320 00000100:00100000:1.0:1788666854.626567:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525080320 00000100:00100000:1.0:1788666854.626593:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788666854.626600:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:25078:x1875552525080320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666854.626669:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:25078:x1875552525080320:12345-0@lo:501:mount.lustre.0 Request processed in 69us (371us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788666854.626677:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788666854.626739:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080320:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788666854.626752:0:25078:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788666854.626771:0:25078:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788666854.626777:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.626786:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2200/0x4267b949b564ab24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ab2b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666854.626820:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93706ed88000 10000000:01000000:0.0:1788666854.626860:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788666854.626866:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788666854.626869:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788666854.626874:0:25078:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788666854.626877:0:25078:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788666854.626898:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93705d3e0600/0x4267b949b564ae11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.626907:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93705d3e0600/0x4267b949b564ae11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.626916:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93705d3e0600/0x4267b949b564ae11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666854.626929:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788666854.626955:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.626969:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.627019:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525080448 00000100:00100000:1.0:1788666854.627023:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525080448 00000100:00100000:1.0:1788666854.627039:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788666854.627044:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:25078:x1875552525080448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666854.627052:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666854.627062:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937040030200/0x4267b949b564ae18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ae11 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.627089:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937040030200/0x4267b949b564ae18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ae11 expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.627100:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937040030200/0x4267b949b564ae18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ae11 expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.627109:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040030200, rc 0) 00000100:00100000:1.0:1788666854.627141:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080448:12345-0@lo:101:mount.lustre.0 Request processed in 96us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.627147:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788666854.627197:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666854.627209:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93705d3e0600/0x4267b949b564ae11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae18 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.627218:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93705d3e0600/0x4267b949b564ae11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ae18 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788666854.628039:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788666854.628507:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666854.629853:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788666854.629894:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788666854.629908:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788666854.629921:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788666854.629946:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788666854.629957:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788666854.629983:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788666854.629996:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788666854.630009:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788666854.630032:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788666854.630038:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788666854.630127:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666854.630182:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.630220:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.630325:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525080576 00000100:00100000:1.0:1788666854.630334:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525080576 00000100:00100000:1.0:1788666854.630372:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788666854.630379:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666854.630519:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080576:12345-0@lo:501:mount.lustre.0 Request processed in 139us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.630528:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788666854.630673:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666854.630704:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666854.630745:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.630772:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.630819:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525080704 00000100:00100000:1.0:1788666854.630825:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525080704 00000100:00100000:1.0:1788666854.630869:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788666854.630875:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666854.631641:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080704:12345-0@lo:503:mount.lustre.0 Request processed in 763us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.631650:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788666854.631730:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788666854.632133:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788666854.632207:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666854.632263:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.632351:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788666854.632494:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525080832 00000100:00100000:3.0:1788666854.632500:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525080832 00000100:00100000:2.0:1788666854.632552:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788666854.632563:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666854.632990:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080832:12345-0@lo:502:mount.lustre.0 Request processed in 429us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666854.632997:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788666854.633083:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788666854.633268:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788666854.633293:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788666854.633306:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788666854.633318:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788666854.633330:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788666854.633341:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788666854.633353:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788666854.633378:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788666854.633390:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1788666854.633412:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666854.633445:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.633481:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.633525:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525080960 00000100:00100000:1.0:1788666854.633530:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525080960 00000100:00100000:1.0:1788666854.633571:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788666854.633578:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666854.633658:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525080960:12345-0@lo:502:mount.lustre.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.633664:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788666854.633774:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525080960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788666854.633823:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788666854.633862:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788666854.634740:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788666854.634748:0:25082:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788666854.634755:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666854.634757:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788666854.634763:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666854.634777:0:25082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9370475b3380) 00000020:00000080:1.0:1788666854.634801:0:25082:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788666854.634816:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788666854.634945:0:25082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93706ed88000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788666854.634953:0:25082:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788666854.634959:0:25082:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4267b949b564ae26 00010000:00010000:1.0:1788666854.638719:0:25082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788666854.639154:0:25082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1788666854.640443:0:25082:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788666854.641516:0:25082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788666854.641527:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666854.641532:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666854.641534:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788666854.641548:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666854.641553:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666854.641554:0:25082:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788666854.641558:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788666854.641560:0:25082:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788666854.641562:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666854.641565:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666854.641566:0:25082:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788666854.641575:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666854.641578:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666854.641579:0:25082:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788666854.641583:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788666854.641861:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666854.641866:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666854.641868:0:25082:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788666854.641872:0:25082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788666854.642351:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788666854.642379:0:25078:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788666854.643367:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93705d3e0600/0x4267b949b564ae11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae18 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666854.643383:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93705d3e0600/0x4267b949b564ae11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae18 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666854.643392:0:25078:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93706ed88000 from 1 10000000:01000000:2.0:1788666854.643395:0:25078:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788666854.643433:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666854.643442:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666854.643452:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666854.643477:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666854.643538:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666854.643588:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.643785:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525081088 00000100:00100000:1.0:1788666854.643792:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525081088 00000100:00100000:1.0:1788666854.643882:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788666854.643891:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525081088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666854.643905:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666854.643917:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ae2d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.643941:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ae2d expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.643952:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ae2d expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.643961:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040031a00, rc 0) 00000100:00100000:1.0:1788666854.643998:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081088:12345-0@lo:101:mount.lustre.0 Request processed in 108us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.644005:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788666854.644155:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666854.644176:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.644187:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788666854.648477:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788666854.648740:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666854.649344:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788666854.649373:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788666854.649388:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788666854.649403:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788666854.649417:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788666854.649430:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788666854.649448:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788666854.649461:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788666854.649474:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788666854.649488:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788666854.649500:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788666854.649520:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788666854.649525:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788666854.649674:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666854.649736:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.649962:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666854.650960:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525081216 00000100:00100000:3.0:1788666854.650971:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525081216 00000100:00100000:3.0:1788666854.651022:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788666854.651031:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666854.651181:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081216:12345-0@lo:501:mount.lustre.0 Request processed in 151us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666854.651189:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788666854.651521:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666854.651564:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666854.651619:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.651667:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666854.652026:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525081344 00000100:00100000:3.0:1788666854.652032:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525081344 00000100:00100000:3.0:1788666854.652072:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788666854.652081:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666854.652180:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081344:12345-0@lo:503:mount.lustre.0 Request processed in 100us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666854.652187:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788666854.652381:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fa2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788666854.652769:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666854.652930:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666854.652978:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666854.653058:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.653123:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525081472 00000100:00100000:1.0:1788666854.653129:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525081472 00000100:00100000:1.0:1788666854.653203:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788666854.653212:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666854.653428:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081472:12345-0@lo:502:mount.lustre.0 Request processed in 216us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.653436:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788666854.653521:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666854.653733:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788666854.653759:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788666854.653773:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788666854.653785:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788666854.653797:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788666854.653821:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788666854.653869:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788666854.653887:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788666854.653900:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788666854.653912:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788666854.653924:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788666854.653947:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666854.653985:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666854.654009:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff937066075240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.654039:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525081600 00000100:00100000:1.0:1788666854.654045:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525081600 00000100:00100000:1.0:1788666854.654076:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788666854.654083:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666854.654155:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081600:12345-0@lo:502:mount.lustre.0 Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.654162:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788666854.654230:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666854.654341:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788666854.654349:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788666854.655084:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666854.655094:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666854.655096:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788666854.655102:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93706ed88000 00000020:00000080:2.0:1788666854.655105:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788666854.655112:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666854.655114:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666854.655115:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788666854.655118:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666854.655121:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666854.655122:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788666854.655125:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93706ed88000 00000020:00000080:2.0:1788666854.655127:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788666854.655224:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666854.655228:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666854.655229:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788666854.655231:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666854.655234:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666854.655236:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788666854.655239:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93706ed88000 00000020:00000080:2.0:1788666854.655241:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788666854.656009:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666854.656016:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666854.656018:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788666854.656022:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666854.656027:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666854.656028:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788666854.656033:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93706ed88000 00000020:00000080:2.0:1788666854.656037:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788666854.656178:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666854.656182:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666854.656184:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788666854.656187:0:25086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788666854.657016:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788666854.657047:0:25078:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788666854.657060:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.657073:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666854.657129:0:25078:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788666854.657132:0:25078:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff93706ed88000 10000000:01000000:1.0:1788666854.657135:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93706ed88000 10000000:01000000:1.0:1788666854.657139:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788666854.657144:0:25078:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff93706ed88000 from 1 10000000:01000000:1.0:1788666854.657147:0:25078:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788666854.657177:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030600/0x4267b949b564ae3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.657186:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937040030600/0x4267b949b564ae3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.657202:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937040030600/0x4267b949b564ae3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666854.657223:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788666854.657303:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.657342:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370441ad6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666854.657419:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525081728 00000100:00100000:3.0:1788666854.657427:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525081728 00000100:00100000:3.0:1788666854.657472:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788666854.657482:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+23:25078:x1875552525081728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666854.657494:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666854.657506:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f8600/0x4267b949b564ae42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ae3b expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.657527:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f8600/0x4267b949b564ae42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ae3b expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.657537:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f8600/0x4267b949b564ae42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ae3b expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.657551:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f8600, rc 0) 00000100:00100000:3.0:1788666854.657587:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525081728:12345-0@lo:101:mount.lustre.0 Request processed in 106us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666854.657593:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788666854.657900:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666854.657914:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937040030600/0x4267b949b564ae3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae42 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.657922:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937040030600/0x4267b949b564ae3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ae42 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666854.659595:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788666854.659948:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666854.660107:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788666854.660145:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788666854.660161:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788666854.660173:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788666854.660184:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788666854.660197:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788666854.660210:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788666854.660221:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788666854.660234:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788666854.660247:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788666854.661481:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788666854.661499:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788666854.661517:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788666854.661532:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788666854.661557:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788666854.661572:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788666854.661667:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788666854.661704:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788666854.661722:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788666854.661825:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788666854.661872:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788666854.662020:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788666854.662035:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788666854.662048:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788666854.662241:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788666854.662259:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788666854.662274:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788666854.662445:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788666854.662463:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788666854.662477:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788666854.662492:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788666854.662506:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788666854.662519:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788666854.662544:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788666854.662559:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788666854.662571:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788666854.662584:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788666854.662677:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788666854.662692:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788666854.662704:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788666854.662717:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788666854.662730:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788666854.662829:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788666854.663044:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788666854.663060:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788666854.663071:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788666854.663084:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788666854.663106:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788666854.663263:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788666854.663342:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788666854.663363:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788666854.663368:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788666854.663460:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666854.663517:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.663565:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788666854.663621:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525081856 00000100:00100000:0.0:1788666854.663628:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525081856 00000100:00100000:0.0:1788666854.663679:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788666854.663689:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525081856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666854.664108:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525081856:12345-0@lo:501:mount.lustre.0 Request processed in 420us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.664116:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788666854.664175:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666854.664207:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666854.664246:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.664362:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788666854.664395:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525081984 00000100:00100000:0.0:1788666854.664400:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525081984 00000100:00100000:0.0:1788666854.664428:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788666854.664435:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525081984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666854.664668:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525081984:12345-0@lo:503:mount.lustre.0 Request processed in 233us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.664675:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788666854.669776:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525081984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788666854.670564:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788666854.670722:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525082112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666854.670794:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.671516:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788666854.672174:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525082112 00000100:00100000:0.0:1788666854.672182:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525082112 00000100:00100000:0.0:1788666854.672230:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788666854.672240:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525082112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666854.672384:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525082112:12345-0@lo:502:mount.lustre.0 Request processed in 145us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.672392:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788666854.673068:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525082112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666854.673285:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788666854.673329:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788666854.673346:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788666854.673359:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788666854.673372:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788666854.673386:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788666854.673400:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788666854.673412:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788666854.673425:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788666854.673447:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788666854.673460:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788666854.673488:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788666854.673503:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788666854.673515:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788666854.673527:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788666854.673538:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788666854.673551:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788666854.673563:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788666854.673577:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788666854.673606:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788666854.673622:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788666854.673636:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788666854.673649:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788666854.673662:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788666854.673674:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788666854.673688:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788666854.673706:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788666854.673730:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788666854.673759:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788666854.673773:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788666854.673786:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788666854.673800:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788666854.673826:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788666854.673861:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788666854.673888:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788666854.673904:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788666854.673917:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788666854.673929:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788666854.673943:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788666854.673955:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788666854.673965:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788666854.673975:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788666854.673994:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788666854.674014:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788666854.674026:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788666854.674036:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788666854.674047:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788666854.674057:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788666854.674097:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525082240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666854.674149:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.674188:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788666854.675383:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525082240 00000100:00100000:0.0:1788666854.675394:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525082240 00000100:00100000:0.0:1788666854.675445:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788666854.675454:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525082240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666854.675599:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525082240:12345-0@lo:502:mount.lustre.0 Request processed in 146us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.675606:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788666854.676851:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525082240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666854.677136:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788666854.677163:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788666854.677197:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525082368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666854.677256:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.677302:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f436e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788666854.677882:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525082368 00000100:00100000:0.0:1788666854.677890:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525082368 00000100:00100000:0.0:1788666854.677938:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788666854.677946:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525082368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666854.678056:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525082368:12345-0@lo:502:mount.lustre.0 Request processed in 110us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.678063:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788666854.681416:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525082368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666854.681508:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788666854.681522:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788666854.682602:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788666854.682629:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9370475b4d40) 00000020:00000080:1.0:1788666854.682653:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788666854.682762:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93706ed88000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788666854.682767:0:25092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93706ed88000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788666854.682770:0:25092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93706ed88000 3 00010000:00080000:1.0:1788666854.682798:0:25092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff937047f7d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.134@tcp at head 00010000:00010000:1.0:1788666854.685557:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788666854.685824:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788666854.685885:0:25092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788666854.685903:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4267b949b564ae50 00000100:00080000:1.0:1788666854.685913:0:25092:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788666854.685920:0:25092:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff937047f7d000 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666854.685951:0:25092:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f436e5c00 x1875552525082496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666854.685978:0:25092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788666854.686061:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875552525082496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666854.686127:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666854.686185:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525082496 00000100:00100000:2.0:1788666854.686192:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525082496 00000100:00100000:2.0:1788666854.686227:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666854.686234:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875552525082496:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788666854.686275:0:22759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:2.0:1788666854.686308:0:22759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4267b949b564ae57 00000004:00100000:2.0:1788666854.686322:0:22759:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788666854.686350:0:22759:0:(import.c:65:import_set_state_nolock()) ffff936f42169000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666854.686404:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875552525082496:12345-0@lo:38:llog_process_th.0 Request processed in 167us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666854.686412:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788666854.686445:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e5c00 x1875552525082496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666854.686455:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666854.686462:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788666854.686470:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788666854.686474:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788666854.686476:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937047f7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788666854.686481:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875552525082496:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788666854.688426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666854.688432:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666854.688434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666854.688437:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666854.688464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666854.688467:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788666854.688470:0:36:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666854.688476:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 675 00000100:00100000:0.0:1788666854.688480:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525083008:0@lo:400:kworker.0 00000100:00080000:1.0:1788666854.688481:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788666854.688486:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937074b3b800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666854.688502:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f436e7480 x1875552525083136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788666854.688534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.688546:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525082624:0@lo:400:kworker.0 00000100:00100000:0.0:1788666854.688564:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788666854.688570:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525082880:0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.688572:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.688590:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525083264:0@lo:400:kworker.0 00000100:00100000:0.0:1788666854.688590:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.688605:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875552525083520:0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.688610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.688623:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.688650:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525083008 00000100:00100000:0.0:1788666854.688657:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525083008 00000100:00100000:1.0:1788666854.688703:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788666854.688706:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666854.688708:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525082752:0@lo:400:kworker.0 00000100:00100000:0.0:1788666854.688713:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525083008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.688737:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.688753:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875552525083392:0@lo:400:kworker.0 00000100:00100000:0.0:1788666854.688754:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525083008:12345-0@lo:400:kworker.0 Request processed in 42us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.688760:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666854.688771:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.688780:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525082624 00000100:00100000:0.0:1788666854.688783:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525082624 00000100:00100000:1.0:1788666854.688790:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525083264 00000100:00100000:1.0:1788666854.688794:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525083264 00000100:00100000:1.0:1788666854.688823:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525083520 00000100:00100000:0.0:1788666854.688823:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525082880 00000100:00100000:1.0:1788666854.688826:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525083520 00000100:00100000:0.0:1788666854.688826:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525082880 00000100:00100000:1.0:1788666854.688851:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525082752 00000100:00100000:1.0:1788666854.688853:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525082752 00000100:00100000:0.0:1788666854.688853:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788666854.688858:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525082624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.688863:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525083392 00000100:00100000:1.0:1788666854.688865:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525083392 00000100:00100000:1.0:1788666854.688881:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788666854.688886:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525083264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666854.688893:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525082624:12345-0@lo:400:kworker.0 Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.688899:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788666854.688910:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788666854.688912:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525083264:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.688915:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525082880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.688918:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788666854.688931:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788666854.688936:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875552525083520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666854.688937:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525082880:12345-0@lo:400:kworker.0 Request processed in 22us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.688942:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788666854.688956:0:22759:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788666854.688958:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875552525083520:12345-0@lo:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.688962:0:22759:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788666854.688963:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788666854.688970:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666854.688973:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788666854.688974:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788666854.688976:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666854.688977:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525082752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.689000:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525082752:12345-0@lo:400:kworker.0 Request processed in 22us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.689000:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525082880:0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.689006:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788666854.689010:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e5c00 x1875552525083520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666854.689015:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788666854.689020:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875552525083520:0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.689026:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875552525083392:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788666854.689028:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e4a80 x1875552525083008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666854.689035:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525083008:0@lo:400:kworker.0 00000100:00100000:1.0:1788666854.689049:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875552525083392:12345-0@lo:400:kworker.0 Request processed in 24us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.689055:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788666854.689065:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e6680 x1875552525082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666854.689085:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525082752:0@lo:400:kworker.0 00010000:00080000:0.0:1788666854.689095:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e7800 x1875552525083392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666854.689102:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875552525083392:0@lo:400:kworker.0 00000100:00100000:0.0:1788666854.689109:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525082624:0@lo:400:kworker.0 00010000:00080000:0.0:1788666854.689122:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e7b80 x1875552525083264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666854.689130:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525083264:0@lo:400:kworker.0 00000100:00100000:2.0:1788666854.689566:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525083136:0@lo:8:kworker.0 00000100:00100000:2.0:1788666854.689598:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788666854.690429:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788666854.690455:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff936f432f0000) 00000020:00000080:1.0:1788666854.690479:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788666854.690571:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93706ed88000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788666854.690575:0:25092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93706ed88000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788666854.690577:0:25092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93706ed88000 3 00010000:00080000:1.0:1788666854.690605:0:25092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff936f422c9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.134@tcp at head 00000100:00100000:2.0:1788666854.690740:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525083136 00000100:00100000:2.0:1788666854.690748:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525083136 00000100:00100000:2.0:1788666854.690789:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666854.690796:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875552525083136:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788666854.690883:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875552525083136:12345-0@lo:8:kworker.0 Request processed in 86us (1284us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788666854.690890:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666854.690922:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666854.690930:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666854.690934:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788666854.690937:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525083136:0@lo:8:kworker.0 00010000:00010000:1.0:1788666854.695204:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788666854.695524:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788666854.695570:0:25092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788666854.695580:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4267b949b564ae65 00000100:00080000:1.0:1788666854.695589:0:25092:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788666854.695595:0:25092:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff936f422c9800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666854.695761:0:25092:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f436e5180 x1875552525083648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788666854.695822:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875552525083648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666854.695900:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788666854.695969:0:25092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788666854.695995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666854.695999:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666854.696001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666854.696004:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788666854.696170:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:2.0:1788666854.696410:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525083648 00000100:00100000:2.0:1788666854.696417:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525083648 00000100:00100000:2.0:1788666854.696485:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666854.696492:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875552525083648:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788666854.696518:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:2.0:1788666854.696545:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4267b949b564ae6c 00000004:00100000:2.0:1788666854.696557:0:22760:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788666854.696583:0:22760:0:(import.c:65:import_set_state_nolock()) ffff93706ed8c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666854.696644:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875552525083648:12345-0@lo:38:llog_process_th.0 Request processed in 150us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666854.696651:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788666854.696780:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff936f436e5180 x1875552525083648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666854.696791:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666854.696797:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788666854.696811:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788666854.696815:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788666854.696818:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f422c9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788666854.696823:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875552525083648:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788666854.696884:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788666854.696919:0:25078:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788666854.696931:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030600/0x4267b949b564ae3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae42 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.696941:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937040030600/0x4267b949b564ae3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae42 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788666854.696981:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788666854.696983:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788666854.696984:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666854.696985:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666854.696986:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666854.696987:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666854.696989:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666854.696990:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666854.696992:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788666854.696995:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788666854.696997:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788666854.696999:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788666854.697000:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666854.697001:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666854.697002:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666854.697002:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666854.697003:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666854.697004:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666854.697005:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788666854.697018:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788666854.697028:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525083776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788666854.697062:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666854.697088:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525083776 00000100:00100000:1.0:1788666854.697092:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525083776 00000100:00100000:1.0:1788666854.697126:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788666854.697132:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:25078:x1875552525083776:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788666854.697151:0:22752:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788666854.697169:0:22752:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788666854.697441:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042abca80 going to sleep for 11 seconds 20000000:01000000:1.0:1788666854.709388:0:22752:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788666854.709409:0:22752:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788666854.709502:0:22774:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788666854.709507:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788666854.709528:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.709546:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ade0 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.709554:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564adee expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.709562:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.709600:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564adee expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.709613:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564adee expref: 24 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666854.709636:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525083904:0@lo:104: 00000100:00100000:3.0:1788666854.709695:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788666854.709751:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ade0 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.709772:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ade0 expref: 24 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666854.709782:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525084032:0@lo:104: 00000100:00100000:3.0:1788666854.709815:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666854.709865:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051b11900 going to sleep for 11 seconds 00000100:00100000:1.0:1788666854.710018:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525083904 00000100:00100000:1.0:1788666854.710025:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525083904 00000100:00100000:1.0:1788666854.710055:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525084032 00000100:00100000:1.0:1788666854.710058:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525084032 00000100:00100000:1.0:1788666854.710071:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666854.710079:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+4:22774:x1875552525083904:12345-0@lo:104: 00010000:00010000:1.0:1788666854.710091:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.710146:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788666854.710152:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+4:22774:x1875552525083904:12345-0@lo:104: Request processed in 75us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.710159:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666854.710176:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788666854.710181:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525084032:12345-0@lo:104: 00010000:00010000:1.0:1788666854.710189:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666854.710216:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788666854.710221:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:22774:x1875552525084032:12345-0@lo:104: Request processed in 41us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.710227:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788666854.710318:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666854.710324:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710332:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788666854.710336:0:22747:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710344:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666854.710351:0:22747:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666854.710356:0:22747:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788666854.710392:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710409:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666854.710429:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710437:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a3400/0x4267b949b564adee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564adf5 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710448:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666854.710451:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710456:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a2600 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788666854.710458:0:22747:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710464:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666854.710469:0:22747:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666854.710473:0:22747:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788666854.710485:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710490:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666854.710503:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710508:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a2600/0x4267b949b564ade0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ade7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710524:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666854.710526:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666854.710527:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666854.710581:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525084160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666854.710610:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.710658:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525084288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666854.710680:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666854.710714:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525084160 00000100:00100000:0.0:1788666854.710719:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525084160 00010000:00010000:0.0:1788666854.710736:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564adee expref: 25 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666854.710755:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525084288 00000100:00100000:0.0:1788666854.710758:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525084288 00010000:00010000:0.0:1788666854.710769:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ade0 expref: 26 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666854.710779:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788666854.710785:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a62c9863-c7b0-471d-812b-42670ca06572+26:3639:x1875552525084160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666854.710795:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666854.710799:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564adee expref: 26 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710821:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564adee expref: 26 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710853:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666854.710881:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a62c9863-c7b0-471d-812b-42670ca06572+26:3639:x1875552525084160:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.710894:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788666854.710908:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666854.710913:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a62c9863-c7b0-471d-812b-42670ca06572+25:3640:x1875552525084288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666854.710921:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666854.710924:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ade0 expref: 25 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710932:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ade0 expref: 25 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710943:0:22745:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710949:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788666854.710960:0:22745:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015034990s 00010000:00010000:0.0:1788666854.710964:0:22745:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710970:0:22745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710976:0:22745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710981:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.710987:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666854.710996:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.711004:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.711012:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666854.711022:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666854.711051:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a62c9863-c7b0-471d-812b-42670ca06572+25:3640:x1875552525084288:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666854.711057:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666854.711094:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525084288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666854.711118:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525084160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666854.711279:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666854.711298:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93706f7a3800/0x4267b949b564adf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564adee expref: 24 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666854.711308:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525083904:0@lo:104: 00010000:00010000:3.0:1788666854.711317:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f9a00/0x4267b949b564ade7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ade0 expref: 23 pid: 22753 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666854.711324:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1875552525084032:0@lo:104: 00010000:00010000:3.0:1788666854.711337:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.711344:0:22774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.711350:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666854.711356:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f9200/0x4267b949b564ae73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666854.711602:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+22:25078:x1875552525083776:12345-0@lo:253:mount.lustre.0 Request processed in 14469us (14538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666854.711610:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788666854.711737:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a62c9863-c7b0-471d-812b-42670ca06572:25078:1875552525083776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788666854.711753:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788666854.711756:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788666854.711758:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666854.711759:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666854.711760:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666854.711761:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666854.711762:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666854.711763:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666854.711765:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666854.711766:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788666854.711776:0:25078:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788666854.713368:0:25078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788666854.716107:0:25078:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788666854.716116:0:25078:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788666854.716151:0:25078:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788666854.716188:0:25078:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788666854.716208:0:25078:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788666854.716224:0:25078:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788666854.721112:0:25078:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788666854.721363:0:25078:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788666855.068462:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788666855.438957:0:25146:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788666855.440829:0:25146:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788666856.094347:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788666856.476321:0:22756:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788666856.476329:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9370523c9800 from 14 10000000:01000000:1.0:1788666856.476334:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788666856.476390:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031c00/0x4267b949b564ae7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666856.476402:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937040031c00/0x4267b949b564ae7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666856.476413:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937040031c00/0x4267b949b564ae7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666856.476435:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525084416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666856.476497:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666856.476541:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666856.477226:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525084416 00000100:00100000:0.0:1788666856.477236:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525084416 00000100:00100000:0.0:1788666856.477296:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788666856.477308:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:22756:x1875552525084416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666856.477333:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666856.477349:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93705d3e1c00/0x4267b949b564ae81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ae7a expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666856.477374:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93705d3e1c00/0x4267b949b564ae81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ae7a expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666856.477385:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93705d3e1c00/0x4267b949b564ae81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ae7a expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666856.477408:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93705d3e1c00, rc 0) 00000100:00100000:0.0:1788666856.477458:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525084416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666856.477467:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788666856.478587:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525084416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666856.478606:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937040031c00/0x4267b949b564ae7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae81 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666856.478618:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937040031c00/0x4267b949b564ae7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ae81 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666856.478671:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525084544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788666856.478712:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666856.478740:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666856.478970:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525084544 00000100:00100000:0.0:1788666856.478976:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525084544 00000100:00100000:0.0:1788666856.479023:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788666856.479032:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525084544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788666856.479048:0:22752:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788666856.479066:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788666856.479069:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788666856.479159:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525084544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666856.479167:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788666856.481816:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525084544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788666856.481932:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788666856.481942:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031c00/0x4267b949b564ae7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae81 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666856.481951:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937040031c00/0x4267b949b564ae7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae81 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666856.481962:0:22756:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788666856.481964:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff937065bbb800 from 14 10000000:01000000:1.0:1788666856.481967:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788666856.482000:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030a00/0x4267b949b564ae88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666856.482008:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937040030a00/0x4267b949b564ae88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666856.482016:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937040030a00/0x4267b949b564ae88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666856.482035:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525084672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666856.482088:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666856.482127:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666856.482702:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525084672 00000100:00100000:0.0:1788666856.482711:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525084672 00000100:00100000:0.0:1788666856.482770:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788666856.482780:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525084672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666856.482805:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666856.482820:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93705d3e0200/0x4267b949b564ae8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564ae88 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666856.482876:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93705d3e0200/0x4267b949b564ae8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564ae88 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666856.482888:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93705d3e0200/0x4267b949b564ae8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ae88 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666856.482908:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93705d3e0200, rc 0) 00000100:00100000:0.0:1788666856.482966:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:22756:x1875552525084672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666856.482973:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788666856.482998:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525084672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666856.483016:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937040030a00/0x4267b949b564ae88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae8f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666856.483037:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937040030a00/0x4267b949b564ae88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564ae8f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666856.483088:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525084800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788666856.483124:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666856.484664:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937041377180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666856.485110:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525084800 00000100:00100000:3.0:1788666856.485120:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525084800 00000100:00100000:3.0:1788666856.485175:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788666856.485185:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:22756:x1875552525084800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788666856.485208:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788666856.485230:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788666856.485233:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788666856.485346:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:22756:x1875552525084800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (2220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666856.485354:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788666856.485679:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525084800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788666856.485741:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788666856.485750:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030a00/0x4267b949b564ae88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae8f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666856.485760:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937040030a00/0x4267b949b564ae88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564ae8f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666857.121421:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666857.372197:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525084928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788666857.372268:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666857.372379:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525084928 00000100:00100000:1.0:1788666857.372387:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525084928 00000100:00100000:1.0:1788666857.372441:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666857.372451:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525084928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788666857.372479:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666857.372518:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525084928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666857.372534:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788666857.372599:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788666857.372650:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f436e5f80 x1875552525084928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666857.372669:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525084928:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788666857.500593:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788666858.140128:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666858.397016:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666858.397040:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525085056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666858.397105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666858.397145:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525085056 00000100:00100000:0.0:1788666858.397151:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525085056 00000100:00100000:0.0:1788666858.397190:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788666858.397198:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525085056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788666858.397232:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788666858.397275:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525085056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666858.397282:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788666858.397318:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525085056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788666858.908824:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525085184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788666858.908932:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666858.909674:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525085184 00000100:00100000:3.0:1788666858.909682:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525085184 00000100:00100000:3.0:1788666858.909740:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788666858.909749:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525085184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788666858.909795:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788666858.920617:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525085184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10858us (11675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666858.920633:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788666858.926057:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525085184:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788666859.167908:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788666859.677621:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788666859.931981:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666859.931988:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666859.931990:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666859.931993:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666859.932022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666859.932025:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788666859.932028:0:36:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666859.932039:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff937074b3b800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666859.932060:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f436e5f80 x1875552525085952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666859.932125:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525085440:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932186:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932241:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875552525086080:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932266:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932285:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875552525086592:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932325:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788666859.932331:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525085312:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932359:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932382:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525085824:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932432:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875552525086464:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932497:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525085568:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932519:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932534:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525086208:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932551:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932562:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666859.932567:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525085696:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932619:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525086336:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932640:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932662:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525085952:0@lo:8:kworker.0 00000100:00100000:1.0:1788666859.932683:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.932713:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525085440 00000100:00100000:1.0:1788666859.932720:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525085440 00000100:00100000:1.0:1788666859.932759:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525085696 00000100:00100000:1.0:1788666859.932761:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525085696 00000100:00100000:1.0:1788666859.932789:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788666859.932798:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525085440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932883:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525085440:12345-0@lo:400:kworker.0 Request processed in 86us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.932890:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788666859.932909:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666859.932915:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525085696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.932945:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525085696:12345-0@lo:400:kworker.0 Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.932960:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666859.932981:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525086080 00000100:00100000:1.0:1788666859.932985:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525086080 00000100:00100000:1.0:1788666859.933002:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525086592 00000100:00100000:1.0:1788666859.933004:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525086592 00000100:00100000:1.0:1788666859.933030:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525086464 00000100:00100000:1.0:1788666859.933033:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525086464 00000100:00100000:1.0:1788666859.933046:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525085568 00000100:00100000:1.0:1788666859.933048:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525085568 00000100:00100000:1.0:1788666859.933057:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525086208 00000100:00100000:1.0:1788666859.933059:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525086208 00000100:00100000:1.0:1788666859.933069:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525086336 00000100:00100000:1.0:1788666859.933072:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525086336 00000100:00100000:1.0:1788666859.933085:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788666859.933092:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875552525086080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.933123:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875552525086080:12345-0@lo:400:kworker.0 Request processed in 32us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933129:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788666859.933141:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666859.933147:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875552525086592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.933172:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875552525086592:12345-0@lo:400:kworker.0 Request processed in 26us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933177:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666859.933188:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788666859.933194:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875552525086464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.933220:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875552525086464:12345-0@lo:400:kworker.0 Request processed in 26us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933225:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788666859.933243:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788666859.933249:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525085568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.933277:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525085568:12345-0@lo:400:kworker.0 Request processed in 28us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933282:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788666859.933292:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788666859.933298:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525086208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.933337:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525086208:12345-0@lo:400:kworker.0 Request processed in 39us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933343:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788666859.933355:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788666859.933361:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525086336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.933386:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525086336:12345-0@lo:400:kworker.0 Request processed in 26us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933392:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788666859.933411:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525085312 00000100:00100000:1.0:1788666859.933415:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525085312 00000100:00100000:1.0:1788666859.933441:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788666859.933447:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:3641:x1875552525085312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.933476:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:3641:x1875552525085312:12345-0@lo:400:kworker.0 Request processed in 28us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933482:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788666859.933507:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525085824 00000100:00100000:1.0:1788666859.933511:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525085824 00000100:00100000:1.0:1788666859.933536:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525085952 00000100:00100000:1.0:1788666859.933540:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525085952 00000100:00100000:1.0:1788666859.933553:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666859.933566:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525085824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.933596:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525085824:12345-0@lo:400:kworker.0 Request processed in 31us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933601:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666859.933613:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788666859.933617:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1875552525085952:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788666859.933644:0:24263:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:1.0:1788666859.933673:0:24263:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4267b949b564ae96 00002000:00100000:1.0:1788666859.933686:0:24263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff936f422c8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788666859.933691:0:24263:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788666859.933694:0:24263:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788666859.933912:0:24263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788666859.933936:0:24263:0:(import.c:65:import_set_state_nolock()) ffff936f422ca800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666859.933975:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1875552525085952:12345-0@lo:8:kworker.0 Request processed in 356us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.933981:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788666859.934013:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666859.934017:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666859.934019:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788666859.934051:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f436e5f80 x1875552525085952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788666884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788666859.934066:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788666859.934072:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788666859.934077:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788666859.934079:0:3637:0:(import.c:65:import_set_state_nolock()) ffff937074b3b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788666859.934090:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788666859.934101:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875552525085952:0@lo:8:kworker.0 00000100:00100000:1.0:1788666859.934136:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525085696:0@lo:400:kworker.0 00010000:00080000:1.0:1788666859.934147:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f436e5180 x1875552525086336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666859.934155:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525086336:0@lo:400:kworker.0 00010000:00080000:1.0:1788666859.934167:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f436e5c00 x1875552525085568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666859.934175:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525085568:0@lo:400:kworker.0 00010000:00080000:1.0:1788666859.934186:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f436e7480 x1875552525086208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666859.934194:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525086208:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.934225:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525085312:0@lo:400:kworker.0 00010000:00080000:1.0:1788666859.934238:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f436e7800 x1875552525085824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666859.934247:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525085824:0@lo:400:kworker.0 00010000:00080000:1.0:1788666859.934259:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937074ac7b80 x1875552525086464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666859.934265:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875552525086464:0@lo:400:kworker.0 00000100:00100000:1.0:1788666859.934279:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525085440:0@lo:400:kworker.0 00010000:00080000:1.0:1788666859.934290:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f436e7b80 x1875552525086080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666859.934310:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875552525086080:0@lo:400:kworker.0 00010000:00080000:1.0:1788666859.934324:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937074ac4000 x1875552525086592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666859.934332:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875552525086592:0@lo:400:kworker.0 00000004:00080000:0.0:1788666859.934499:0:23502:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788666859.934518:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f603800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875552525086848:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788666859.934553:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666859.934572:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074bd4c00 going to sleep for 11 seconds 00000004:00080000:0.0:1788666859.934595:0:23501:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788666859.934658:0:23501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 682977822845ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788666859.934663:0:23501:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788666859.934971:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666859.934982:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525086720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788666859.935011:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666859.935038:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525086720 00000100:00100000:1.0:1788666859.935043:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525086720 00000100:00100000:1.0:1788666859.935083:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788666859.935091:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875552525086720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788666859.935113:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788666859.935149:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875552525086720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.935155:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788666859.935174:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788666859.935194:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93707f600380 x1875552525086720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666859.935210:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525086720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788666859.935252:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525086848 00000100:00100000:1.0:1788666859.935256:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525086848 00000100:00100000:1.0:1788666859.935278:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666859.935284:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23502:x1875552525086848:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788666859.941821:0:23490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788666859.946290:0:24263:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788666859.946310:0:24263:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788666859.946427:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23502:x1875552525086848:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11135us (11864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.946441:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788666859.946481:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93707f603800 x1875552525086848/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788666875 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666859.946500:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f603800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875552525086848:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788666859.946518:0:23502:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788666859.946562:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875552525086976:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788666859.946628:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666859.946663:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074bd4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666859.946984:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525086976 00000100:00100000:1.0:1788666859.946992:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525086976 00000100:00100000:1.0:1788666859.947048:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788666859.947056:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23502:x1875552525086976:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788666859.947085:0:24938:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788666859.947124:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23502:x1875552525086976:12345-0@lo:5:osp-pre-1-1.0 Request processed in 69us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.947132:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788666859.947279:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f43765500 x1875552525086976/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666875 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666859.947288:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875552525086976:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788666859.947299:0:23502:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788666859.947326:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875552525087104:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788666859.947350:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666859.947375:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff937074bd4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666859.948944:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525087104 00000100:00100000:1.0:1788666859.948956:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525087104 00000100:00100000:1.0:1788666859.949064:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788666859.949074:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23502:x1875552525087104:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788666859.949110:0:24261:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:3.0:1788666859.983146:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788666859.983162:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788666859.983510:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23502:x1875552525087104:12345-0@lo:5:osp-pre-1-1.0 Request processed in 34426us (36147us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788666859.983525:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788666859.990077:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f43765500 x1875552525087104/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666875 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666859.990092:0:23502:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788666859.990098:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875552525087104:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788666859.990116:0:23502:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788666859.990169:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23502:1875552525087232:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788666859.990226:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666859.990262:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042dad180 going to sleep for 11 seconds 00000100:00100000:1.0:1788666859.991769:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525087232 00000100:00100000:1.0:1788666859.991801:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525087232 00000100:00100000:1.0:1788666859.991913:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788666859.991927:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23502:x1875552525087232:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788666859.992055:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23502:x1875552525087232:12345-0@lo:900:osp-pre-1-1.0 Request processed in 131us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666859.992066:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788666859.992113:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f1f80 x1875552525087232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788666875 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666859.992130:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23502:1875552525087232:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1788666860.195344:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788666860.351422:0:25436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg634-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788666860.956156:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666840/real 1788666840] req@ffff93707f602a00 x1875552525071104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666860.956194:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93707f602a00 x1875552525071104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666860.956210:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666840/real 1788666840] req@ffff93707f603b80 x1875552525071232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666860.956234:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93707f603b80 x1875552525071232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788666860.956280:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f43c77800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666860.956342:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788666860.956347:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525071104:0@lo:8:kworker.0 00000100:00080000:2.0:1788666860.956354:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9370523ca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666860.956632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666860.956637:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788666860.956641:0:8:0:(import.c:65:import_set_state_nolock()) ffff936f43c77800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788666860.956647:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:3.0:1788666860.956655:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788666860.956663:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff936f43c77800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:1.0:1788666860.956787:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525087360:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.956905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.956980:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788666860.956989:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.957027:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.957059:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525087360 00000100:00100000:1.0:1788666860.957067:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525087360 00000100:00100000:1.0:1788666860.957122:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788666860.957134:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:3639:x1875552525087360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.957198:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:3639:x1875552525087360:12345-0@lo:400:kworker.0 Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.957206:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788666860.957260:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525087488 00000100:00100000:1.0:1788666860.957266:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525087488 00000100:00100000:1.0:1788666860.957301:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788666860.957309:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525087488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.957357:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525087488:12345-0@lo:400:kworker.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.957363:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788666860.957426:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.957474:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525087360:0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.957805:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f427f3800 x1875552525087616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788666860.957824:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788666860.957829:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788666860.957831:0:8:0:(import.c:65:import_set_state_nolock()) ffff9370523ca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788666860.957852:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:3.0:1788666860.957857:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788666860.957864:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9370523ca800 using connection 192.168.206.134@tcp/0@lo 00000100:00100000:3.0:1788666860.957887:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936f427f0a80 x1875552525087744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666860.958051:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525088000:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958092:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.958173:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525088512:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958206:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.958244:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666860.958271:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525088128:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.958331:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875552525088640:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.958417:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525088512 00000100:00100000:1.0:1788666860.958424:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525088512 00000100:00100000:1.0:1788666860.958485:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525088640 00000100:00100000:1.0:1788666860.958489:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525088640 00000100:00100000:1.0:1788666860.958524:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788666860.958534:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525088512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958599:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525088512:12345-0@lo:400:kworker.0 Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.958606:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788666860.958623:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788666860.958629:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875552525088640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958658:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875552525088640:12345-0@lo:400:kworker.0 Request processed in 29us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.958665:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788666860.958691:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525088128 00000100:00100000:1.0:1788666860.958696:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525088128 00000100:00100000:1.0:1788666860.958727:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788666860.958735:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525088128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958809:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525088128:12345-0@lo:400:kworker.0 Request processed in 74us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.958817:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788666860.958888:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525087872:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958926:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.958945:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875552525088384:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.958964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.958979:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788666860.958985:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525088256:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.959006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.959031:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875552525088768:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.959051:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.959075:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525088256 00000100:00100000:1.0:1788666860.959079:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525088256 00000100:00100000:1.0:1788666860.959104:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666860.959111:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525088256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.959157:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525088256:12345-0@lo:400:kworker.0 Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.959164:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666860.959183:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525087872 00000100:00100000:1.0:1788666860.959188:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525087872 00000100:00100000:1.0:1788666860.959205:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525088384 00000100:00100000:1.0:1788666860.959208:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525088384 00000100:00100000:1.0:1788666860.959222:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525088768 00000100:00100000:1.0:1788666860.959224:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525088768 00000100:00100000:1.0:1788666860.959236:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788666860.959243:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525087872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.959280:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525087872:12345-0@lo:400:kworker.0 Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.959287:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788666860.959299:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788666860.959313:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875552525088384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.959347:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875552525088384:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.959353:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788666860.959365:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788666860.959370:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875552525088768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.959397:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875552525088768:12345-0@lo:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.959404:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788666860.959459:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f2d80 x1875552525088128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.959475:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525088128:0@lo:400:kworker.0 00010000:00080000:1.0:1788666860.959498:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f1180 x1875552525088640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.959509:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875552525088640:0@lo:400:kworker.0 00010000:00080000:1.0:1788666860.959528:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f1500 x1875552525088512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.959537:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525088512:0@lo:400:kworker.0 00010000:00080000:1.0:1788666860.959571:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f3480 x1875552525088256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.959579:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525088256:0@lo:400:kworker.0 00010000:00080000:1.0:1788666860.959589:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f42068380 x1875552525088768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.959610:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875552525088768:0@lo:400:kworker.0 00010000:00080000:1.0:1788666860.959622:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f1c00 x1875552525087872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.959630:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525087872:0@lo:400:kworker.0 00010000:00080000:1.0:1788666860.959639:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f0e00 x1875552525088384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.959647:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875552525088384:0@lo:400:kworker.0 00000100:00080000:2.0:1788666860.960086:0:3637:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788666860.960095:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525071232:0@lo:8:kworker.0 00000100:00100000:2.0:1788666860.960130:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525087616:0@lo:8:kworker.0 00000100:00100000:2.0:1788666860.960178:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666860.960246:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525087744:0@lo:8:kworker.0 00000100:00100000:2.0:1788666860.960281:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.960662:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525087616 00000100:00100000:1.0:1788666860.960670:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525087616 00000100:00100000:3.0:1788666860.963321:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525088000 00000100:00100000:3.0:1788666860.963346:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525088000 00000100:00100000:3.0:1788666860.963500:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788666860.963515:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525088000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.963737:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525088000:12345-0@lo:400:kworker.0 Request processed in 226us (5644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666860.963746:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788666860.963871:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525088000:0@lo:400:kworker.0 00000100:00100000:1.0:1788666860.964433:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525087744 00000100:00100000:1.0:1788666860.964454:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525087744 00000100:00100000:1.0:1788666860.964497:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666860.964505:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1875552525087616:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788666860.964549:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000100:00100000:2.0:1788666860.964782:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666860.964791:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875552525087744:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788666860.964814:0:24261:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:2.0:1788666860.964881:0:24261:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4267b949b564aea4 00002000:00100000:2.0:1788666860.964903:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93707c737800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788666860.964908:0:24261:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788666860.964911:0:24261:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788666860.965021:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788666860.965056:0:24261:0:(import.c:65:import_set_state_nolock()) ffff93707c734000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666860.965143:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875552525087744:12345-0@lo:8:kworker.0 Request processed in 352us (4862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666860.965153:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788666860.965234:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f0a80 x1875552525087744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788666885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666860.965260:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666860.965272:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788666860.965284:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788666860.965291:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788666860.965294:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9370523ca800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788666860.965314:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788666860.965321:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525087744:0@lo:8:kworker.0 00000020:00000080:1.0:1788666860.965445:0:24264:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4267b949b564ae9d 00002000:00100000:1.0:1788666860.965454:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff936f422cc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788666860.965459:0:24264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788666860.965461:0:24264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788666860.965520:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788666860.965543:0:24264:0:(import.c:65:import_set_state_nolock()) ffff936f422cd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666860.965604:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875552525087616:12345-0@lo:8:kworker.0 Request processed in 1098us (5426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.965612:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:1.0:1788666860.965692:0:22785:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788666860.965730:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42525f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22785:1875552525089152:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788666860.965793:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.965826:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff93707b904600 going to sleep for 11 seconds 00000004:00080000:1.0:1788666860.965872:0:22784:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788666860.965949:0:22784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 684009114492ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788666860.965956:0:22784:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788666860.966389:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525089152 00000100:00100000:1.0:1788666860.966398:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525089152 00000100:00100000:1.0:1788666860.966454:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788666860.966465:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22785:x1875552525089152:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788666860.966984:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788666860.967008:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666860.967025:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525089024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666860.967085:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666860.967234:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525089024 00000100:00100000:1.0:1788666860.967242:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525089024 00000100:00100000:1.0:1788666860.967296:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666860.967305:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875552525089024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666860.967333:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788666860.967382:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875552525089024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666860.967390:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788666860.967612:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f427f3800 x1875552525087616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788666885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666860.967625:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666860.967634:0:3637:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788666860.967644:0:3637:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788666860.967651:0:3637:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788666860.967655:0:3637:0:(import.c:65:import_set_state_nolock()) ffff936f43c77800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788666860.967672:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788666860.967810:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875552525087616:0@lo:8:kworker.0 00000004:00080000:2.0:1788666860.967886:0:22782:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788666860.967892:0:22783:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788666860.967927:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43767100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22783:1875552525089408:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788666860.968001:0:22782:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 684011165333ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788666860.968013:0:22782:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788666860.968030:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666860.968204:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff937051b11000 going to sleep for 11 seconds 00000100:00100000:2.0:1788666860.968307:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525089408 00000100:00100000:2.0:1788666860.968316:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525089408 00000100:00100000:2.0:1788666860.968364:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666860.968375:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22783:x1875552525089408:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1788666860.969384:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666860.969416:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525089280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666860.969549:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666860.969746:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525089280 00000100:00100000:2.0:1788666860.969753:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525089280 00000100:00100000:2.0:1788666860.969809:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666860.969825:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875552525089280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666860.969875:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788666860.969922:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875552525089280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666860.969929:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788666860.970070:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f42526300 x1875552525089024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.970110:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525089024:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788666860.970146:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f43766680 x1875552525089280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666860.970161:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525089280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666860.970667:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666860.970951:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525088896:0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.971009:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666860.971173:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525089536:0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.971204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666860.971228:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666860.971234:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525089664:0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.971263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666860.971295:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525089536 00000100:00100000:3.0:1788666860.971302:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525089536 00000100:00100000:3.0:1788666860.971344:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788666860.971352:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525089536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.971411:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525089536:12345-0@lo:400:kworker.0 Request processed in 58us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666860.971420:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788666860.971815:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525088896 00000100:00100000:2.0:1788666860.971821:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525088896 00000100:00100000:2.0:1788666860.971887:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788666860.971895:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:3640:x1875552525088896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666860.971935:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:3640:x1875552525088896:12345-0@lo:400:kworker.0 Request processed in 41us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666860.971942:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788666860.972735:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525089536:0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.972751:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525088896:0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.973415:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525089664 00000100:00100000:3.0:1788666860.973424:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525089664 00002000:00080000:1.0:1788666860.973543:0:24261:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788666860.973554:0:24261:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788666860.973562:0:24261:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:3.0:1788666860.974674:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788666860.974693:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525089664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666860.974821:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525089664:12345-0@lo:400:kworker.0 Request processed in 134us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666860.974830:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788666860.974918:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f4206ad80 x1875552525089664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666860.974950:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525089664:0@lo:400:kworker.0 00002000:00080000:2.0:1788666860.975200:0:24263:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788666860.975211:0:24263:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1788666860.975217:0:24263:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:1.0:1788666860.987740:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666860.987792:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.987815:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666860.987820:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666860.987828:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.987868:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.987881:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.987891:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.987935:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788666860.988095:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666860.988111:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.988146:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666860.988152:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.988164:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.988197:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.988206:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564aeab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.988240:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666860.988242:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666860.988244:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666860.989730:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666860.989745:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.989764:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666860.989778:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666860.989784:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.989801:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.989813:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.989823:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.989862:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788666860.989907:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666860.989922:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.989946:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040030c00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666860.989952:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.989966:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.990008:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.990015:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090136955/0x4267b949b564aeb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666860.990180:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666860.990183:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666860.990185:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666860.991158:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666860.991168:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.991183:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666860.991197:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666860.991203:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788666860.991317:0:22738:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788666860.992863:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.992887:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.992895:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.992915:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666860.993192:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666860.993201:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.993211:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666860.993218:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.993229:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.993255:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.993264:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564aeb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.993291:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666860.993293:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666860.993296:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666860.994890:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666860.994902:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.994922:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666860.994928:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666860.994937:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.994952:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.994962:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.994986:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666860.995012:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666860.995518:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666860.995527:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.995550:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040030e00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666860.995556:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.995567:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.995882:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.995894:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564aec0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666860.995920:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666860.995922:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666860.995924:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788666860.999241:0:22738:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788666861.001109:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788666861.001134:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666861.007604:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.007626:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.007655:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.007661:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.007670:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.007694:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.007724:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.007734:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.007781:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788666861.008123:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788666861.008134:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666861.008142:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.008167:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.008178:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.008186:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.008562:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.008571:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.008591:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.008597:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.008608:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.008652:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.008660:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564aece lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.008689:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.008692:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.008695:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.009084:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.009092:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009103:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.009107:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.009112:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009123:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009132:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009139:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009168:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.009179:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.009184:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009192:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.009195:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009290:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009305:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009313:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564aed5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.009329:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.009330:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.009332:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.010073:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.010082:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.010094:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.010103:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.010109:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.010121:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.010131:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.010140:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.010205:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.011531:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.011545:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.011562:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.011567:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.011579:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.011602:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.011611:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564aedc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.011818:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.011821:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.011823:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666861.012000:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.012016:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.012119:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.012124:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.012131:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.012141:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.012146:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.012156:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.012164:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.012177:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788666861.012430:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666861.012439:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012448:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e0c00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.012453:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012611:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012642:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012651:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e52ad7/0x4267b949b564aec7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012670:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.012674:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012681:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a2600 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.012684:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012692:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012702:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012709:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564aee3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.012724:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.012726:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.012733:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.012741:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788666861.013105:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788666861.013114:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013125:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788666861.013129:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666861.013135:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013157:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013167:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013175:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013194:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.013284:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.013291:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013300:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e0e00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.013304:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013313:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013337:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013346:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed6e81ef/0x4267b949b564aeea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788666861.013363:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.013366:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.013369:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.013371:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013372:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.013382:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788666861.013391:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666861.013396:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013409:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013417:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013425:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013439:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788666861.013584:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.013589:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666861.013591:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013597:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013603:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.013611:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e1800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666861.013611:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666861.013617:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013618:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013639:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013642:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013660:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013662:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013682:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000112a7d9/0x4267b949b564aef1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013685:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013710:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.013717:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.013722:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013730:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e0a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.013734:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013742:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013754:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013762:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4428ed3/0x4267b949b564aef8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.013788:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.013789:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.013792:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.013828:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788666861.013935:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788666861.013941:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013950:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788666861.013953:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666861.013969:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.013980:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.014019:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.014028:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.014044:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.014099:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.014105:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014114:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e1600 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.014118:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014126:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014139:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014147:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4203f3b/0x4267b949b564aeff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014160:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.014162:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.014163:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666861.014672:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.014681:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.014691:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.014702:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.014707:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.014720:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.014729:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.014738:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.014762:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.014796:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.014803:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014812:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.014822:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014855:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014869:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014877:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000537fc105/0x4267b949b564af06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.014896:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.014898:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.014900:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666861.016248:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.016265:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.016282:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.016286:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.016292:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.016304:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.016314:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.016335:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.016351:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.016428:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.016436:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.016445:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.016451:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.016460:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666861.017083:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.017092:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017102:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.017106:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.017110:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017121:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017129:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017137:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017153:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666861.017322:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.017328:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017344:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.017348:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.017352:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017364:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017374:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017382:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.017398:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788666861.018485:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018501:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008665f820/0x4267b949b564af0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018532:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666861.018537:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018546:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.018551:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018561:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018573:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018581:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da72c4f1/0x4267b949b564af14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018600:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.018604:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018611:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370821c6400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.018620:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018628:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018640:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018648:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.018665:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.018667:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.018670:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.018679:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.018687:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666861.019765:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.019787:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.019803:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.019808:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.019816:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.019869:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.019896:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.019903:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.019921:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666861.020184:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.020191:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.020200:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.020204:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.020208:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.020220:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.020229:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.020237:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.020263:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788666861.021660:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666861.021672:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021685:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370821c7a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.021691:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021703:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021742:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021751:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021785:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.021790:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021797:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370821c6e00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.021801:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021809:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021820:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021827:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ab0031c/0x4267b949b564af29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.021860:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.021862:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.021871:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666861.022145:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.022153:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.022165:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.022169:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.022176:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.022188:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.022198:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.022206:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788666861.022291:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788666861.022300:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022318:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788666861.022322:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666861.022327:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022339:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022348:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022355:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.022376:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788666861.022881:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788666861.022892:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666861.022897:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022905:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370821c7000 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666861.022909:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022919:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022946:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022967:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.022989:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666861.022994:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.023002:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e1400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666861.023007:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.023015:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.023025:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.023032:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564af37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.023049:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.023051:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.023059:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666861.023070:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.023076:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.023085:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.023095:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.023100:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.023111:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.023119:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.023126:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.023147:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.023158:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.023165:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.023171:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.023174:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.023179:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.023187:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.023200:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.023207:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004424e4d7/0x4267b949b564af3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.023222:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.023224:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.023225:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.023233:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.025345:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.025361:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.025378:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.025383:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.025403:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.025418:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.025429:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.025511:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.026597:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788666861.027819:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.027866:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.027884:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.027890:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.027898:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.027914:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.027926:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.027952:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666861.028154:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.028162:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.028171:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.028174:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.028179:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.028190:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.028198:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.028212:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028271:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788666861.028281:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028291:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.028296:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028307:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028332:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028340:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bfb27e3/0x4267b949b564af45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028363:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666861.028368:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028388:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.028392:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028400:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028412:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028421:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666861.028425:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028431:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.028448:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028457:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028469:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.028479:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.028486:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.028489:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.030303:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788666861.030323:0:24263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564af4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.032270:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788666861.032286:0:24261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.032333:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.032498:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.032507:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.032525:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.032531:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.032540:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.032560:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.032572:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.032580:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.032613:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788666861.033014:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666861.033091:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.033102:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f8200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.033108:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.033118:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.033139:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.033148:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022ef8ed0/0x4267b949b564af5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.033165:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.033167:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.033169:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.033178:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666861.033283:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.033291:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.033302:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.033305:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.033310:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.033321:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.033330:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.033338:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.033369:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666861.034122:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.034131:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.034144:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.034148:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.034153:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.034165:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.034174:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.034182:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.034205:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788666861.034343:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666861.034351:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034359:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.034364:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034372:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034387:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034396:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1b8beb/0x4267b949b564af61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034414:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.034418:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034425:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9c00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.034429:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034763:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034786:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034794:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564af68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034810:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.034812:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.034814:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.034908:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.034914:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034924:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.034928:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.034932:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034944:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034952:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034968:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.034985:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.034993:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.034997:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.035005:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f8a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.035009:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.035016:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.035026:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.035034:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b801720f/0x4267b949b564af6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.035048:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.035049:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.035051:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.035472:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666861.035969:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.035979:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.035989:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.035999:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.036005:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.036018:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.036027:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.036035:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.036059:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.036268:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.036280:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036289:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.036295:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036305:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036320:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036328:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034cecf22/0x4267b949b564af76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036345:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.036347:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.036349:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.036395:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.036401:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036409:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.036412:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.036417:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036453:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036462:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036470:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.036483:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.036790:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.036796:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.036805:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370821c7000 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.036809:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.036817:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666861.037101:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.037108:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037117:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.037120:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.037125:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037135:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037145:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037165:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037183:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788666861.037524:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.037530:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037540:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.037543:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.037548:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037557:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037565:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037574:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037590:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788666861.037598:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666861.037603:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037619:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370821c7a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.037624:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037633:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037647:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037657:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079b220ce/0x4267b949b564af84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037678:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.037681:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037689:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370821c6400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.037693:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037700:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037710:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037725:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006275fe/0x4267b949b564af8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.037743:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.037745:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.037747:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.038152:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.038159:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038168:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.038172:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.038176:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038187:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038195:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038202:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038226:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.038234:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.038244:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038251:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.038255:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038262:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038273:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038281:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da72c4f1/0x4267b949b564af92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038296:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.038298:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.038300:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.038638:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.038644:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038653:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.038656:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.038660:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038681:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038691:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038698:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038714:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.038721:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.038726:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038733:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.038737:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038745:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038756:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038765:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008665f820/0x4267b949b564af99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.038796:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.038799:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.038801:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.039292:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.039358:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.039365:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039375:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.039379:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.039384:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039394:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039403:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039412:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039499:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788666861.039859:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.039866:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039889:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.039892:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.039897:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039906:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039914:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039923:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.039936:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788666861.040163:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666861.040172:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040194:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a3800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.040199:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040209:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666861.040321:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.040327:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.040335:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.040338:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.040343:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.040352:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.040370:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.040377:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.040388:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788666861.040529:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040538:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537fc105/0x4267b949b564afa0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040565:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666861.040569:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040576:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a2600 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.040580:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040588:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040598:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040613:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb94b4a/0x4267b949b564afa7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040627:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666861.040630:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040637:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937082045600 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.040640:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040648:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040659:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040666:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c24d646/0x4267b949b564afae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.040679:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.040681:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.040683:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.040692:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.040800:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.040827:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdf88e26/0x4267b949b564af7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.040864:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.040866:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.040868:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666861.041179:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.041207:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666861.041315:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.041321:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041331:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.041335:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.041340:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041351:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041360:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041368:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.041448:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.041452:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.041456:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.041467:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.041475:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.041483:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041506:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788666861.041899:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.041905:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041915:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.041918:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.041922:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041932:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041941:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.041949:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.041991:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788666861.041998:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042007:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375fa00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.042012:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042022:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042038:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042046:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd132258/0x4267b949b564afbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042062:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666861.042066:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042079:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040030e00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.042082:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042091:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042101:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042108:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.042112:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042119:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375fc00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.042122:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042130:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042138:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042144:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.042149:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.042151:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.042201:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788666861.042207:0:24261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d584cb32/0x4267b949b564afb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.042612:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666861.042695:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.042702:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.042711:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.042715:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.042725:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.042736:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.042745:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.042753:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.042991:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.043356:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.043364:0:24263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564afc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.043827:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666861.043859:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.043870:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.043876:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.043889:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.043911:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.043934:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b207ea10/0x4267b949b564afca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.043950:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.043952:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.043954:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.044284:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.044292:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.044310:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.044315:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.044321:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.044334:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.044355:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.044363:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.044381:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788666861.045148:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.045157:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045168:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.045171:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.045176:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045188:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045208:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045276:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045294:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788666861.045799:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.045805:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045814:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.045817:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.045822:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045925:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045936:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045944:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.045966:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788666861.046180:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788666861.046189:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046198:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375ec00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.046203:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046221:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046241:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046250:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b42c2800/0x4267b949b564afd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046271:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666861.046275:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046289:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375ee00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.046293:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046300:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046311:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046318:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564afd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046330:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666861.046333:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046339:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375f400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.046342:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046362:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046372:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046386:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b97f3278/0x4267b949b564afdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046400:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.046402:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.046403:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666861.046495:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.046501:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046511:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.046514:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.046519:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046531:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046540:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046546:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046561:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788666861.046570:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666861.046580:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046597:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040030c00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.046601:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046610:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046623:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046629:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090136955/0x4267b949b564afe6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.046644:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.046646:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.046648:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666861.047959:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.047972:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.047987:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.047992:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.047997:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048093:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048107:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048116:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048138:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788666861.048154:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666861.048160:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048169:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:1.0:1788666861.048175:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048184:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048201:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048210:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4ce1972/0x4267b949b564afed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.048301:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.048303:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.048305:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.048765:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.048785:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048796:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.048799:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.048803:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048816:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048825:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048850:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048871:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.048881:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.048885:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048893:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666861.048904:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048914:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048927:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048935:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007393a964/0x4267b949b564aff4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.048955:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.048958:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666861.048961:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666861.049562:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.049570:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.049581:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.049924:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.049937:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.049985:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.049993:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.050006:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.050016:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666861.050171:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.050178:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.050187:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.050190:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.050194:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.050205:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.050281:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.050309:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.050433:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666861.050656:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.050675:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.050692:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.051135:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051145:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.051150:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051161:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051181:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051189:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073b6d7df/0x4267b949b564affb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051528:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.051533:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051541:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375f000 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.051545:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051562:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051574:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.051582:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000631c1f09/0x4267b949b564b002 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788666861.051753:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.051760:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.051794:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.051798:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.051804:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.051817:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.051826:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.051856:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.051875:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788666861.052211:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.052225:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.052235:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.052239:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.052243:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.052254:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.052263:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.052271:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.052281:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788666861.052469:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666861.052474:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052482:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031000 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.052487:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052495:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052510:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052519:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064268a73/0x4267b949b564b009 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052546:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.052550:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052557:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.052560:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052568:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052579:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052709:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a8acad/0x4267b949b564b010 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.052726:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.052728:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.052731:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.052740:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.052745:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.053579:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788666861.053699:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.053709:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.053723:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.053728:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.053733:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.053745:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.053782:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.053791:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.053817:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666861.054123:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.054139:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.054142:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.054146:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.054157:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.054165:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.054172:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.054195:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788666861.054376:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666861.054384:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054407:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f8a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.054413:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054424:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054581:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054660:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b801720f/0x4267b949b564b01e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054684:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.054687:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054695:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375fc00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.054698:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054706:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054717:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054730:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f7f52e/0x4267b949b564b017 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.054746:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.054749:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.054750:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.055123:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.055280:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.055289:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.055300:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.055304:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.055309:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.055323:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.055352:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.055361:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.055379:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.055690:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.055698:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.055708:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375fe00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.055713:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.055721:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.055735:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.055744:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f2e872/0x4267b949b564b025 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.055762:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.055764:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.055766:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666861.055926:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.055933:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.055943:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.055946:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.055951:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.055962:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.055970:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.055978:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.056009:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.056389:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.056395:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.056405:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.056409:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.056417:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.056430:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.056514:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf66678/0x4267b949b564b02c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.056535:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.056537:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.056539:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788666861.057034:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.057042:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.057052:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.057056:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.057060:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.057071:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.057079:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.057086:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.057117:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666861.057416:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666861.057423:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.057431:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.057445:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.057468:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.057484:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.057492:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007454a22b/0x4267b949b564b033 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.057510:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.057512:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666861.057513:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666861.057963:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.057971:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.057980:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.057984:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.057989:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.057999:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.058007:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.058014:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.058033:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788666861.058255:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788666861.058262:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.058273:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1788666861.058276:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666861.058280:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.058290:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.058298:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.058306:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666861.058328:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788666861.058751:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666861.058759:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.058777:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f8200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666861.058782:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.058792:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.058808:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.058829:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022ef8ed0/0x4267b949b564b03a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.058915:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666861.058923:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.058933:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375f600 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666861.058937:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.058947:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.058960:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.058969:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000246736bb/0x4267b949b564b041 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.058988:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.058991:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.058993:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666861.059866:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788666861.060057:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788666861.060066:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.060081:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1788666861.060094:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666861.060101:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.060115:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.060126:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.060134:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666861.060159:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788666861.061425:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788666861.061438:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.061453:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788666861.061458:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666861.061472:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.061488:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.061499:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.061507:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.061537:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788666861.062025:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788666861.062032:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062041:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1788666861.062044:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666861.062048:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062058:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062067:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062088:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062108:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788666861.062120:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788666861.062127:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062136:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666861.062142:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062152:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062175:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062183:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfb27e3/0x4267b949b564b048 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062205:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666861.062210:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062240:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e1400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666861.062243:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062252:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062263:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062270:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b0e3258/0x4267b949b564b04f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062286:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666861.062289:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062296:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e1e00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666861.062299:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062306:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062316:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062329:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000333a47f1/0x4267b949b564b056 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.062342:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.062344:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.062346:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788666861.062390:0:24261:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1788666861.062536:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22785:x1875552525089152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96067us (96738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666861.062547:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788666861.062912:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666861.063739:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42525f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22785:1875552525089152:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1788666861.063745:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788666861.063777:0:22785:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788666861.063874:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42525f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22785:1875552525089792:0@lo:5:osp-pre-1-0.0 00002000:00010000:2.0:1788666861.063933:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788666861.063943:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.063960:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1788666861.063965:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666861.063971:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.063985:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.063996:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.064005:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666861.064028:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788666861.064377:0:24263:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1788666861.064396:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788666861.064477:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666861.064487:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.064496:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8c00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666861.064502:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.064513:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.064534:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.064543:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f0e1331/0x4267b949b564b05d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666861.064596:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.064599:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666861.064601:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666861.066906:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22783:x1875552525089408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98519us (98867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666861.066935:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666861.066979:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525089792 00000100:00100000:2.0:1788666861.066991:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525089792 00000100:00100000:2.0:1788666861.067055:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788666861.067065:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22785:x1875552525089792:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788666861.067125:0:24263:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788666861.068536:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042b8f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666861.068719:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43767100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22783:1875552525089408:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788666861.068739:0:22783:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788666861.068817:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22783:1875552525089920:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788666861.068916:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666861.068944:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042b8f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666861.069736:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525089920 00000100:00100000:3.0:1788666861.069747:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525089920 00000100:00100000:3.0:1788666861.069807:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666861.069818:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22783:x1875552525089920:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788666861.069895:0:24264:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1788666861.076809:0:24258:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788666861.076909:0:24258:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788666861.077448:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22783:x1875552525089920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7625us (8527us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788666861.077461:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666861.077527:0:22783:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788666861.077538:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22783:1875552525089920:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788666861.077557:0:22783:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000001:00080000:1.0:1788666861.078081:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00100000:1.0:1788666861.078124:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788666861.078492:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22785:x1875552525089792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11426us (14095us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788666861.078501:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666861.078665:0:22785:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788666861.078673:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42525f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22785:1875552525089792:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788666861.078685:0:22785:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1788666861.212963:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788666861.335530:0:25488:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788666861.335814:0:25488:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788666862.240791:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788666862.409595:0:25538:0:(tgt_mount.c:2352:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788666862.410043:0:25538:0:(tgt_mount.c:2367:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788666862.497927:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666862.497960:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525090048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788666862.498059:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666862.498212:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525090048 00000100:00100000:1.0:1788666862.498224:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525090048 00000100:00100000:1.0:1788666862.498310:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788666862.498323:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525090048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788666862.498359:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666862.498421:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525090048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.498430:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788666862.498500:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525090048:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788666862.498569:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666862.681262:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.681534:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505054336 00000100:00100000:1.0:1788666862.681548:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505054336 00000100:00100000:1.0:1788666862.681606:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 115 00000100:00100000:1.0:1788666862.681616:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1875552505054336:12345-192.168.206.34@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788666862.683409:0:22753:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 42372aab-04b6-4821-a139-fec1a872a41d@192.168.206.34@tcp t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:1.0:1788666862.683466:0:22753:0:(genops.c:1385:class_connect()) connect: client 42372aab-04b6-4821-a139-fec1a872a41d, cookie 0x4267b949b564b064 00000100:00080000:1.0:1788666862.683605:0:22753:0:(import.c:65:import_set_state_nolock()) ffff936f422cb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666862.683676:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+5:2393:x1875552505054336:12345-192.168.206.34@tcp:250:mount.lustre.0 Request processed in 2060us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.683703:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 115 00000100:00100000:3.0:1788666862.694807:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666862.694917:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505054464 00000100:00100000:0.0:1788666862.694931:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505054464 00000100:00100000:3.0:1788666862.695046:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 116 00000100:00100000:3.0:1788666862.695059:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+5:18077:x1875552505054464:12345-192.168.206.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788666862.695081:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666862.695104:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff936f4375f800/0x4267b949b564b06b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52e35 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666862.695144:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff936f4375f800/0x4267b949b564b06b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e35 expref: 6 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666862.695158:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff936f4375f800/0x4267b949b564b06b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e35 expref: 6 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666862.695169:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375f800, rc 0) 00000100:00100000:3.0:1788666862.695508:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+6:18077:x1875552505054464:12345-192.168.206.34@tcp:101:mount.lustre.0 Request processed in 450us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.695516:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 116 00000100:00100000:0.0:1788666862.698321:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666862.698530:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505054592 00000100:00100000:2.0:1788666862.698543:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505054592 00000100:00100000:2.0:1788666862.698610:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 117 00000100:00100000:2.0:1788666862.698622:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+6:18077:x1875552505054592:12345-192.168.206.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788666862.698806:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+6:18077:x1875552505054592:12345-192.168.206.34@tcp:501:mount.lustre.0 Request processed in 186us (500us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666862.698815:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 117 00000100:00100000:0.0:1788666862.702729:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.702937:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505054720 00000100:00100000:3.0:1788666862.702950:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505054720 00000100:00100000:3.0:1788666862.703014:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 118 00000100:00100000:3.0:1788666862.703024:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+6:18077:x1875552505054720:12345-192.168.206.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788666862.703044:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666862.703064:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff936f4375e200/0x4267b949b564b072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52e3c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666862.703096:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff936f4375e200/0x4267b949b564b072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e3c expref: 7 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666862.703108:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff936f4375e200/0x4267b949b564b072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e3c expref: 7 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666862.703118:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375e200, rc 0) 00000100:00100000:3.0:1788666862.703181:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+7:18077:x1875552505054720:12345-192.168.206.34@tcp:101:mount.lustre.0 Request processed in 158us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.703189:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 118 00000100:00100000:3.0:1788666862.706539:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.706674:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505054848 00000100:00100000:1.0:1788666862.706687:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505054848 00000100:00100000:1.0:1788666862.706755:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 119 00000100:00100000:1.0:1788666862.706776:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+7:18077:x1875552505054848:12345-192.168.206.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788666862.707025:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+8:18077:x1875552505054848:12345-192.168.206.34@tcp:501:mount.lustre.0 Request processed in 251us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.707035:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 119 00000100:00100000:0.0:1788666862.711982:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.712125:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505054976 00000100:00100000:3.0:1788666862.712139:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505054976 00000100:00100000:3.0:1788666862.712218:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 120 00000100:00100000:3.0:1788666862.712231:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+8:18077:x1875552505054976:12345-192.168.206.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788666862.712617:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+8:18077:x1875552505054976:12345-192.168.206.34@tcp:503:mount.lustre.0 Request processed in 387us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.712635:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 120 00000100:00100000:0.0:1788666862.720078:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666862.720180:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505055104 00000100:00100000:2.0:1788666862.720196:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505055104 00000100:00100000:2.0:1788666862.720268:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 121 00000100:00100000:2.0:1788666862.720281:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+8:18095:x1875552505055104:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788666862.720510:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+8:18095:x1875552505055104:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 232us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666862.720527:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 121 00000100:00100000:2.0:1788666862.742928:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.749314:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505055232 00000100:00100000:3.0:1788666862.749337:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505055232 00000100:00100000:3.0:1788666862.749441:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 122 00000100:00100000:3.0:1788666862.749455:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+8:18095:x1875552505055232:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788666862.749682:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+8:18095:x1875552505055232:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 230us (6769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.749692:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 122 00000100:00100000:0.0:1788666862.760059:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.760160:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505055360 00000100:00100000:1.0:1788666862.760174:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505055360 00000100:00100000:1.0:1788666862.760246:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 123 00000100:00100000:1.0:1788666862.760258:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+8:18095:x1875552505055360:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666862.760466:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+8:18095:x1875552505055360:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 209us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.760475:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 123 00000100:00100000:0.0:1788666862.765590:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.765733:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505055488 00000100:00100000:1.0:1788666862.765751:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505055488 00000100:00100000:1.0:1788666862.765917:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 124 00000100:00100000:1.0:1788666862.765931:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+8:18077:x1875552505055488:12345-192.168.206.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788666862.765959:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666862.765984:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f8200/0x4267b949b564b079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52e6d expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666862.766027:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f8200/0x4267b949b564b079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e6d expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666862.766068:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f8200/0x4267b949b564b079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e6d expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666862.766082:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f8200, rc 0) 00000100:00100000:1.0:1788666862.766161:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+9:18077:x1875552505055488:12345-192.168.206.34@tcp:101:mount.lustre.0 Request processed in 234us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.766169:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 124 00000100:00100000:3.0:1788666862.770778:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.770975:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505055616 00000100:00100000:1.0:1788666862.770989:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505055616 00000100:00100000:1.0:1788666862.771109:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 125 00000100:00100000:1.0:1788666862.771122:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+9:18077:x1875552505055616:12345-192.168.206.34@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788666862.771158:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788666862.771191:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788666862.771196:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788666862.771200:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788666862.771203:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788666862.771206:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788666862.778045:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+9:18077:x1875552505055616:12345-192.168.206.34@tcp:256:mount.lustre.0 Request processed in 6908us (7275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.778067:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 125 00000100:00100000:0.0:1788666862.785167:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.785383:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505055744 00000100:00100000:1.0:1788666862.785397:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505055744 00000100:00100000:1.0:1788666862.785469:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 126 00000100:00100000:1.0:1788666862.785480:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93704648bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+9:18077:x1875552505055744:12345-192.168.206.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788666862.785504:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666862.785527:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52e74 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666862.785585:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666862.785599:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666862.785610:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f9200, rc 0) 00000100:00100000:1.0:1788666862.785696:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93704648bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+10:18077:x1875552505055744:12345-192.168.206.34@tcp:101:mount.lustre.0 Request processed in 219us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.785704:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 126 00000100:00100000:0.0:1788666862.791341:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.791625:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505055872 00000100:00100000:1.0:1788666862.791639:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505055872 00000100:00100000:1.0:1788666862.791798:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 127 00000100:00100000:1.0:1788666862.791811:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937046488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+10:18077:x1875552505055872:12345-192.168.206.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788666862.792863:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937046488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+10:18077:x1875552505055872:12345-192.168.206.34@tcp:501:mount.lustre.0 Request processed in 1018us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.792877:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 127 00000100:00100000:2.0:1788666862.802958:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.803788:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505056000 00000100:00100000:3.0:1788666862.803804:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505056000 00000100:00100000:3.0:1788666862.803906:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 128 00000100:00100000:3.0:1788666862.803919:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+10:18077:x1875552505056000:12345-192.168.206.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788666862.805532:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+10:18077:x1875552505056000:12345-192.168.206.34@tcp:503:mount.lustre.0 Request processed in 1606us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.805546:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 128 00000100:00100000:0.0:1788666862.815441:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.815623:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505056128 00000100:00100000:1.0:1788666862.815636:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505056128 00000100:00100000:1.0:1788666862.815715:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 129 00000100:00100000:1.0:1788666862.815728:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+10:18098:x1875552505056128:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666862.815973:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+10:18098:x1875552505056128:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 246us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.815982:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 129 00000100:00100000:0.0:1788666862.826348:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.826601:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505056256 00000100:00100000:3.0:1788666862.826614:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505056256 00000100:00100000:2.0:1788666862.827326:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 130 00000100:00100000:2.0:1788666862.827347:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+10:18098:x1875552505056256:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788666862.827554:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+10:18098:x1875552505056256:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 214us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666862.827569:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 130 00000100:00100000:0.0:1788666862.834495:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.836159:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505056384 00000100:00100000:3.0:1788666862.836178:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505056384 00000100:00100000:3.0:1788666862.836260:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:3.0:1788666862.836270:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875552505056384:12345-192.168.206.34@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788666862.836315:0:22759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1e410e58-9219-4ec8-a46c-3adbd93f4c9d@192.168.206.34@tcp t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:3.0:1788666862.836389:0:22759:0:(genops.c:1385:class_connect()) connect: client 1e410e58-9219-4ec8-a46c-3adbd93f4c9d, cookie 0x4267b949b564b087 00000004:00100000:3.0:1788666862.836425:0:22759:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788666862.836779:0:22759:0:(import.c:65:import_set_state_nolock()) ffff936f435c8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666862.836910:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2393:x1875552505056384:12345-192.168.206.34@tcp:38:mount.lustre.0 Request processed in 639us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.836919:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:1.0:1788666862.838382:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.838558:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505056640 00000100:00100000:3.0:1788666862.838568:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505056640 00000100:00100000:3.0:1788666862.838611:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:3.0:1788666862.838619:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875552505056640:12345-192.168.206.34@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788666862.840033:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1e410e58-9219-4ec8-a46c-3adbd93f4c9d@192.168.206.34@tcp t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:3.0:1788666862.840108:0:22760:0:(genops.c:1385:class_connect()) connect: client 1e410e58-9219-4ec8-a46c-3adbd93f4c9d, cookie 0x4267b949b564b08e 00000004:00100000:3.0:1788666862.840141:0:22760:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788666862.846361:0:22760:0:(import.c:65:import_set_state_nolock()) ffff937066593800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666862.853322:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2393:x1875552505056640:12345-192.168.206.34@tcp:38:mount.lustre.0 Request processed in 14682us (14927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.853342:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:0.0:1788666862.855230:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.855330:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505056512 00000100:00100000:3.0:1788666862.855343:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505056512 00000100:00100000:3.0:1788666862.855728:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 9 00000100:00100000:3.0:1788666862.855742:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:0:x1875552505056512:12345-192.168.206.34@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788666862.855813:0:22759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1788666862.856041:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666862.856154:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.856277:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:0:x1875552505056512:12345-192.168.206.34@tcp:41:mount.lustre.0 Request processed in 537us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.856286:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 9 00000100:00100000:3.0:1788666862.856307:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505056896 00000100:00100000:3.0:1788666862.856313:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505056896 00000100:00100000:3.0:1788666862.856348:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 10 00000100:00100000:3.0:1788666862.856374:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18077:x1875552505056896:12345-192.168.206.34@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788666862.856423:0:22759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788666862.856939:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18077:x1875552505056896:12345-192.168.206.34@tcp:41:mount.lustre.0 Request processed in 565us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.856946:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 10 00000100:00100000:1.0:1788666862.862264:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666862.862323:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666862.868133:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505056768 00000100:00100000:2.0:1788666862.868157:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505056768 00000100:00100000:2.0:1788666862.868273:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505057024 00000100:00100000:2.0:1788666862.868277:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505057024 00000100:00100000:2.0:1788666862.868311:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 11 00000100:00100000:2.0:1788666862.868322:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:0:x1875552505056768:12345-192.168.206.34@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788666862.868334:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 12 00000100:00100000:3.0:1788666862.868344:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18077:x1875552505057024:12345-192.168.206.34@tcp:40:mount.lustre.0 00000004:00000024:2.0:1788666862.868372:0:25094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1788666862.868595:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788666862.868904:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18077:x1875552505057024:12345-192.168.206.34@tcp:40:mount.lustre.0 Request processed in 557us (6576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.868914:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 12 00000100:00100000:2.0:1788666862.872151:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:0:x1875552505056768:12345-192.168.206.34@tcp:41:mount.lustre.0 Request processed in 3809us (9881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666862.872171:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 11 00000100:00100000:0.0:1788666862.879828:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666862.879926:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666862.879975:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.880386:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505057408 00000100:00100000:3.0:1788666862.880399:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505057408 00000100:00100000:3.0:1788666862.880493:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 3 00000100:00100000:3.0:1788666862.880505:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18077:x1875552505057408:12345-192.168.206.34@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788666862.880625:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18077:x1875552505057408:12345-192.168.206.34@tcp:900:mount.lustre.0 Request processed in 122us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666862.880634:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 3 00000100:00100000:2.0:1788666862.880873:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505057152 00000100:00100000:2.0:1788666862.880879:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505057152 00000100:00100000:2.0:1788666862.880912:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505057280 00000100:00100000:2.0:1788666862.880915:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505057280 00000100:00100000:2.0:1788666862.880933:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 16 00000100:00100000:2.0:1788666862.880939:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875552505057152:12345-192.168.206.34@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788666862.880967:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 17 00010000:00080000:2.0:1788666862.880972:0:24261:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1e410e58-9219-4ec8-a46c-3adbd93f4c9d@192.168.206.34@tcp t0 exp 0000000000000000 cur 685 last 0 00000100:00100000:1.0:1788666862.880973:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875552505057280:12345-192.168.206.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788666862.881002:0:24938:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1e410e58-9219-4ec8-a46c-3adbd93f4c9d@192.168.206.34@tcp t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:1.0:1788666862.881025:0:24938:0:(genops.c:1385:class_connect()) connect: client 1e410e58-9219-4ec8-a46c-3adbd93f4c9d, cookie 0x4267b949b564b09c 00000020:00000080:2.0:1788666862.881026:0:24261:0:(genops.c:1385:class_connect()) connect: client 1e410e58-9219-4ec8-a46c-3adbd93f4c9d, cookie 0x4267b949b564b095 00002000:00100000:2.0:1788666862.881328:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1e410e58-9219-4ec8-a46c-3adbd93f4c9d/ffff937042dfd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788666862.881344:0:24261:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788666862.881624:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788666862.881662:0:24261:0:(import.c:65:import_set_state_nolock()) ffff937042dff000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666862.881706:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2393:x1875552505057152:12345-192.168.206.34@tcp:8:mount.lustre.0 Request processed in 766us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666862.881713:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 16 00002000:00100000:1.0:1788666862.882157:0:24938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1e410e58-9219-4ec8-a46c-3adbd93f4c9d/ffff936f422ce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788666862.882169:0:24938:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788666862.882800:0:24938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788666862.883062:0:24938:0:(import.c:65:import_set_state_nolock()) ffff9370475bd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666862.883192:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2393:x1875552505057280:12345-192.168.206.34@tcp:8:mount.lustre.0 Request processed in 2215us (3263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666862.883203:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 17 00000100:00100000:0.0:1788666862.891597:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666862.891784:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505057536 00000100:00100000:3.0:1788666862.891798:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505057536 00000100:00100000:0.0:1788666862.892129:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 0 00000100:00100000:0.0:1788666862.892144:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18077:x1875552505057536:12345-192.168.206.34@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788666862.897270:0:22762:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5002us 00000004:00200000:0.0:1788666862.914030:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788666862.914207:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18077:x1875552505057536:12345-192.168.206.34@tcp:33:mount.lustre.0 Request processed in 22058us (22616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666862.914222:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 0 00000100:00100000:0.0:1788666863.137107:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666863.137303:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505057664 00000100:00100000:1.0:1788666863.137317:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505057664 00000100:00100000:1.0:1788666863.137436:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 13 00000100:00100000:1.0:1788666863.137458:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18121:x1875552505057664:12345-192.168.206.34@tcp:101:mkdir.0 00010000:00010000:1.0:1788666863.137486:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666863.137522:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f8a00/0x4267b949b564b0a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52ea5 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666863.137782:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f9a00/0x4267b949b564b0aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666863.137799:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f9a00/0x4267b949b564b0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666863.137858:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f9a00/0x4267b949b564b0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666863.137942:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788666863.137947:0:22759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788666863.137993:0:22759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f9a00/0x4267b949b564b0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666863.138025:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f8a00/0x4267b949b564b0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ea5 expref: 8 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666863.138047:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f9a00/0x4267b949b564b0aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ea5 expref: 7 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666863.138056:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9370439b9d00) 00010000:00010000:1.0:1788666863.138060:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666863.138064:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f9a00, rc 0) 00000100:00100000:1.0:1788666863.138147:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:18121:x1875552505057664:12345-192.168.206.34@tcp:101:mkdir.0 Request processed in 701us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666863.138155:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 13 00010000:00010000:0.0:1788666863.261827:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666863.516567:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525090176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788666863.516679:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666863.517155:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525090176 00000100:00100000:3.0:1788666863.517167:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525090176 00000100:00100000:3.0:1788666863.517281:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788666863.517294:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525090176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788666863.517344:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788666863.517419:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525090176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666863.517462:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788666863.517564:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525090176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666864.028377:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525090304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788666864.028483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666864.028959:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525090304 00000100:00100000:2.0:1788666864.028970:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525090304 00000100:00100000:2.0:1788666864.029101:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788666864.029113:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525090304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788666864.029159:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788666864.029237:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525090304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666864.029245:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788666864.029340:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525090304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788666864.283985:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666865.053969:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525090432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788666865.054074:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666865.054323:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525090432 00000100:00100000:1.0:1788666865.054333:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525090432 00000100:00100000:1.0:1788666865.054417:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788666865.054430:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525090432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788666865.054474:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788666865.054562:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525090432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.054570:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666865.054682:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525090432:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788666865.054964:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788666865.113957:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.114244:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505057792 00000100:00100000:3.0:1788666865.114259:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505057792 00000100:00100000:3.0:1788666865.114359:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 14 00000100:00100000:3.0:1788666865.114372:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:18173:x1875552505057792:12345-192.168.206.34@tcp:41:lfs.0 00000004:00000024:3.0:1788666865.114426:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1788666865.114546:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666865.114880:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:18173:x1875552505057792:12345-192.168.206.34@tcp:41:lfs.0 Request processed in 510us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.114889:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 14 00000100:00100000:0.0:1788666865.117460:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.119690:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505057920 00000100:00100000:3.0:1788666865.119712:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505057920 00000100:00100000:3.0:1788666865.119888:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 15 00000100:00100000:3.0:1788666865.119904:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18173:x1875552505057920:12345-192.168.206.34@tcp:41:lfs.0 00000004:00000024:3.0:1788666865.120197:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788666865.120315:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18173:x1875552505057920:12345-192.168.206.34@tcp:41:lfs.0 Request processed in 415us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.120325:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 15 00000100:00080000:2.0:1788666865.122765:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788666865.129522:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.129741:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505058048 00000100:00100000:1.0:1788666865.129765:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505058048 00000100:00100000:1.0:1788666865.129901:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:1.0:1788666865.129925:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18173:x1875552505058048:12345-192.168.206.34@tcp:13:lfs.0 00002000:00000024:1.0:1788666865.129972:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666865.130172:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18173:x1875552505058048:12345-192.168.206.34@tcp:13:lfs.0 Request processed in 250us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.130181:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00080000:2.0:1788666865.131278:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666865.132328:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.132430:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505058176 00000100:00100000:1.0:1788666865.132601:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505058176 00000100:00100000:1.0:1788666865.132724:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:1.0:1788666865.132735:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18173:x1875552505058176:12345-192.168.206.34@tcp:13:lfs.0 00002000:00000024:1.0:1788666865.132781:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788666865.132915:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18173:x1875552505058176:12345-192.168.206.34@tcp:13:lfs.0 Request processed in 173us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.132923:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00080000:2.0:1788666865.136894:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788666865.308135:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666865.407259:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666865.407401:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505058304 00000100:00100000:2.0:1788666865.407414:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505058304 00000100:00100000:2.0:1788666865.407494:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 131 00000100:00100000:2.0:1788666865.407508:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+10:18205:x1875552505058304:12345-192.168.206.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788666865.407555:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666865.407579:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370474c9800/0x4267b949b564b0b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52eac expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666865.407623:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370474c9800/0x4267b949b564b0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52eac expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666865.407636:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370474c9800/0x4267b949b564b0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52eac expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666865.407646:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c9800, rc 0) 00000100:00100000:2.0:1788666865.407719:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+11:18205:x1875552505058304:12345-192.168.206.34@tcp:101:mount.lustre.0 Request processed in 214us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666865.407727:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 131 00000100:00100000:0.0:1788666865.440018:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666865.440139:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505058432 00000100:00100000:2.0:1788666865.440154:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505058432 00000100:00100000:2.0:1788666865.440241:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 132 00000100:00100000:2.0:1788666865.440253:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+11:18205:x1875552505058432:12345-192.168.206.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788666865.440495:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+11:18205:x1875552505058432:12345-192.168.206.34@tcp:501:mount.lustre.0 Request processed in 243us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666865.440508:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 132 00000100:00100000:0.0:1788666865.451032:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.451816:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505058560 00000100:00100000:1.0:1788666865.451877:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505058560 00000100:00100000:1.0:1788666865.451978:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 133 00000100:00100000:1.0:1788666865.451990:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+11:18205:x1875552505058560:12345-192.168.206.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788666865.452209:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+11:18205:x1875552505058560:12345-192.168.206.34@tcp:503:mount.lustre.0 Request processed in 221us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.452232:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 133 00000100:00100000:0.0:1788666865.462801:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.467911:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505058688 00000100:00100000:1.0:1788666865.467933:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505058688 00000100:00100000:1.0:1788666865.468022:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 134 00000100:00100000:1.0:1788666865.468034:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+11:18212:x1875552505058688:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666865.468252:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+11:18212:x1875552505058688:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 219us (5472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.468261:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 134 00000100:00100000:0.0:1788666865.504028:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666865.504136:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505058816 00000100:00100000:2.0:1788666865.504149:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505058816 00000100:00100000:2.0:1788666865.504230:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 135 00000100:00100000:2.0:1788666865.504243:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+11:18212:x1875552505058816:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788666865.504458:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+11:18212:x1875552505058816:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 216us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666865.504477:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 135 00000100:00100000:0.0:1788666865.519587:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.520517:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505058944 00000100:00100000:3.0:1788666865.520536:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505058944 00000100:00100000:3.0:1788666865.520621:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 136 00000100:00100000:3.0:1788666865.520633:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+11:18212:x1875552505058944:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788666865.521230:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+11:18212:x1875552505058944:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 595us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.521241:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 136 00000100:00100000:0.0:1788666865.524913:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.525064:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505059072 00000100:00100000:1.0:1788666865.525084:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505059072 00000100:00100000:1.0:1788666865.525182:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 137 00000100:00100000:1.0:1788666865.525195:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+11:18205:x1875552505059072:12345-192.168.206.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788666865.525220:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666865.525246:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370582f8a00/0x4267b949b564b0b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52edd expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.525286:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370582f8a00/0x4267b949b564b0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52edd expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.525300:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370582f8a00/0x4267b949b564b0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52edd expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.525313:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370582f8a00, rc 0) 00000100:00100000:1.0:1788666865.525425:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+12:18205:x1875552505059072:12345-192.168.206.34@tcp:101:mount.lustre.0 Request processed in 232us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.525433:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 137 00000100:00100000:0.0:1788666865.532083:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.532214:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505059200 00000100:00100000:3.0:1788666865.532228:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505059200 00000100:00100000:3.0:1788666865.532302:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 138 00000100:00100000:3.0:1788666865.532313:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+12:18205:x1875552505059200:12345-192.168.206.34@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788666865.532352:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788666865.532397:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788666865.532412:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788666865.532415:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788666865.532418:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788666865.532421:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788666865.536600:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+12:18205:x1875552505059200:12345-192.168.206.34@tcp:256:mount.lustre.0 Request processed in 4261us (4508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.536622:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 138 00000100:00100000:0.0:1788666865.541302:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666865.541665:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505059328 00000100:00100000:2.0:1788666865.541679:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505059328 00000100:00100000:2.0:1788666865.542093:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 139 00000100:00100000:2.0:1788666865.542109:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+12:18205:x1875552505059328:12345-192.168.206.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788666865.542134:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666865.542159:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52ee4 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666865.542213:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 13 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666865.542228:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 13 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666865.542239:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c8a00, rc 0) 00000100:00100000:2.0:1788666865.542377:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+13:18205:x1875552505059328:12345-192.168.206.34@tcp:101:mount.lustre.0 Request processed in 273us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666865.542385:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 139 00000100:00100000:0.0:1788666865.547005:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.547189:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505059456 00000100:00100000:3.0:1788666865.547272:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505059456 00000100:00100000:3.0:1788666865.547350:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 140 00000100:00100000:3.0:1788666865.547362:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+13:18205:x1875552505059456:12345-192.168.206.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788666865.547723:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+13:18205:x1875552505059456:12345-192.168.206.34@tcp:501:mount.lustre.0 Request processed in 361us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.547732:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 140 00000100:00100000:1.0:1788666865.558310:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666865.564444:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505059584 00000100:00100000:2.0:1788666865.564464:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505059584 00000100:00100000:2.0:1788666865.567178:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 141 00000100:00100000:2.0:1788666865.567194:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+13:18205:x1875552505059584:12345-192.168.206.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788666865.567354:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+13:18205:x1875552505059584:12345-192.168.206.34@tcp:503:mount.lustre.0 Request processed in 162us (9059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666865.567363:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 141 00000100:00100000:0.0:1788666865.578281:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.578395:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505059712 00000100:00100000:1.0:1788666865.578407:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505059712 00000100:00100000:1.0:1788666865.578471:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 142 00000100:00100000:1.0:1788666865.578481:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+13:18216:x1875552505059712:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666865.578681:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+13:18216:x1875552505059712:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 200us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.578689:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 142 00000100:00100000:1.0:1788666865.604287:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.604399:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505059840 00000100:00100000:3.0:1788666865.604413:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505059840 00000100:00100000:3.0:1788666865.604479:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 143 00000100:00100000:3.0:1788666865.604509:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+13:18216:x1875552505059840:12345-192.168.206.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788666865.604948:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+13:18216:x1875552505059840:12345-192.168.206.34@tcp:502:llog_process_th.0 Request processed in 440us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.604958:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 143 00000100:00100000:2.0:1788666865.610898:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.611028:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505059968 00000100:00100000:1.0:1788666865.611041:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505059968 00000100:00100000:1.0:1788666865.611090:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 16 00000100:00100000:1.0:1788666865.611104:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1875552505059968:12345-192.168.206.34@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788666865.611142:0:25094:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b1ad00b0-8834-4215-915b-cc506c1c34f5@192.168.206.34@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:1.0:1788666865.611200:0:25094:0:(genops.c:1385:class_connect()) connect: client b1ad00b0-8834-4215-915b-cc506c1c34f5, cookie 0x4267b949b564b0c6 00000004:00100000:1.0:1788666865.611231:0:25094:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788666865.611497:0:25094:0:(import.c:65:import_set_state_nolock()) ffff93706ec05800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666865.611725:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2393:x1875552505059968:12345-192.168.206.34@tcp:38:mount.lustre.0 Request processed in 623us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.611736:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 16 00000100:00100000:0.0:1788666865.625356:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.626161:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505060224 00000100:00100000:3.0:1788666865.626176:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505060224 00000100:00100000:2.0:1788666865.626333:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 17 00000100:00100000:2.0:1788666865.626343:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875552505060224:12345-192.168.206.34@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788666865.626409:0:22758:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from b1ad00b0-8834-4215-915b-cc506c1c34f5@192.168.206.34@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:2.0:1788666865.626468:0:22758:0:(genops.c:1385:class_connect()) connect: client b1ad00b0-8834-4215-915b-cc506c1c34f5, cookie 0x4267b949b564b0cd 00000004:00100000:2.0:1788666865.626502:0:22758:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788666865.626644:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9370475aa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666865.629362:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.629421:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.629498:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505060480 00000100:00100000:3.0:1788666865.629513:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505060480 00000100:00100000:3.0:1788666865.629593:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505060096 00000100:00100000:3.0:1788666865.629597:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505060096 00000100:00100000:3.0:1788666865.629618:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 18 00000100:00100000:3.0:1788666865.629628:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+7:18205:x1875552505060480:12345-192.168.206.34@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788666865.629658:0:25094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788666865.629733:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+7:18205:x1875552505060480:12345-192.168.206.34@tcp:41:mount.lustre.0 Request processed in 105us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.629760:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 18 00000100:00100000:0.0:1788666865.629801:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 19 00000100:00100000:0.0:1788666865.629821:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:0:x1875552505060096:12345-192.168.206.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788666865.629928:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788666865.629983:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:0:x1875552505060096:12345-192.168.206.34@tcp:41:mount.lustre.0 Request processed in 169us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666865.630188:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2393:x1875552505060224:12345-192.168.206.34@tcp:38:mount.lustre.0 Request processed in 3842us (4845us total) trans 0 rc 0/0 00000100:00080000:1.0:1788666865.630459:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666865.637650:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 19 00000100:00100000:2.0:1788666865.638545:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 17 00000100:00100000:3.0:1788666865.638696:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.638799:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505060608 00000100:00100000:1.0:1788666865.638815:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505060608 00000100:00100000:1.0:1788666865.638979:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 20 00000100:00100000:1.0:1788666865.638992:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18205:x1875552505060608:12345-192.168.206.34@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788666865.639157:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18205:x1875552505060608:12345-192.168.206.34@tcp:40:mount.lustre.0 Request processed in 168us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.639165:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 20 00000100:00100000:1.0:1788666865.646823:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.646888:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.646932:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.647017:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505060992 00000100:00100000:3.0:1788666865.647027:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505060992 00000100:00100000:3.0:1788666865.647090:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 4 00000100:00100000:3.0:1788666865.647101:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18205:x1875552505060992:12345-192.168.206.34@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788666865.647185:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18205:x1875552505060992:12345-192.168.206.34@tcp:900:mount.lustre.0 Request processed in 87us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.647203:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 4 00000100:00100000:0.0:1788666865.647782:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505060736 00000100:00100000:0.0:1788666865.647789:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505060736 00000100:00100000:0.0:1788666865.647820:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505060864 00000100:00100000:0.0:1788666865.647824:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505060864 00000100:00100000:0.0:1788666865.647869:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 18 00000100:00100000:0.0:1788666865.647876:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f427f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875552505060736:12345-192.168.206.34@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788666865.647908:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b1ad00b0-8834-4215-915b-cc506c1c34f5@192.168.206.34@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:0.0:1788666865.647942:0:24264:0:(genops.c:1385:class_connect()) connect: client b1ad00b0-8834-4215-915b-cc506c1c34f5, cookie 0x4267b949b564b0d4 00002000:00100000:0.0:1788666865.647955:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b1ad00b0-8834-4215-915b-cc506c1c34f5/ffff936f424d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788666865.647968:0:24264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788666865.648035:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788666865.648068:0:24264:0:(import.c:65:import_set_state_nolock()) ffff936f424d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788666865.648110:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f427f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2393:x1875552505060736:12345-192.168.206.34@tcp:8:mount.lustre.0 Request processed in 233us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666865.648117:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 18 00000100:00100000:0.0:1788666865.648134:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 19 00000100:00100000:0.0:1788666865.648139:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875552505060864:12345-192.168.206.34@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788666865.648156:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b1ad00b0-8834-4215-915b-cc506c1c34f5@192.168.206.34@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:0.0:1788666865.648173:0:24264:0:(genops.c:1385:class_connect()) connect: client b1ad00b0-8834-4215-915b-cc506c1c34f5, cookie 0x4267b949b564b0db 00002000:00100000:0.0:1788666865.648178:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b1ad00b0-8834-4215-915b-cc506c1c34f5/ffff936f424d7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788666865.648312:0:24264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788666865.650600:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788666865.650649:0:24264:0:(import.c:65:import_set_state_nolock()) ffff93706ec06000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666865.650734:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2393:x1875552505060864:12345-192.168.206.34@tcp:8:mount.lustre.0 Request processed in 2591us (3799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.650755:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 19 00000100:00100000:0.0:1788666865.655913:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666865.655969:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666865.656500:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505060352 00000100:00100000:3.0:1788666865.656510:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505060352 00000100:00100000:3.0:1788666865.656599:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 21 00000100:00100000:3.0:1788666865.656610:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:0:x1875552505060352:12345-192.168.206.34@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788666865.656639:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788666865.656704:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:0:x1875552505060352:12345-192.168.206.34@tcp:41:mount.lustre.0 Request processed in 96us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666865.656711:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 21 00000100:00080000:0.0:1788666865.657419:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788666865.660482:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505061120 00000100:00100000:2.0:1788666865.660500:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505061120 00000100:00100000:1.0:1788666865.663902:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 1 00000100:00100000:1.0:1788666865.663917:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18205:x1875552505061120:12345-192.168.206.34@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788666865.664007:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788666865.664109:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18205:x1875552505061120:12345-192.168.206.34@tcp:33:mount.lustre.0 Request processed in 195us (8139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.664118:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 1 00000100:00100000:3.0:1788666865.854725:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666865.855056:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505061248 00000100:00100000:1.0:1788666865.855070:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505061248 00000100:00100000:1.0:1788666865.855162:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 22 00000100:00100000:1.0:1788666865.855176:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18239:x1875552505061248:12345-192.168.206.34@tcp:101:mkdir.0 00010000:00010000:1.0:1788666865.855209:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666865.855231:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b0e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f15 expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.855312:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.855348:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.855364:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666865.855451:0:25094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788666865.855457:0:25094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788666865.855483:0:25094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.855521:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b0e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 8 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.855546:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 7 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666865.855554:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9370439b9d00) 00010000:00010000:1.0:1788666865.855558:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666865.855570:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040031800, rc 0) 00000100:00100000:1.0:1788666865.855962:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+7:18239:x1875552505061248:12345-192.168.206.34@tcp:101:mkdir.0 Request processed in 785us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666865.855974:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 22 00000100:00100000:2.0:1788666866.076123:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666866.076146:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525090560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666866.076224:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666866.076349:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525090560 00000100:00100000:1.0:1788666866.076357:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525090560 00000100:00100000:1.0:1788666866.076432:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788666866.076442:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525090560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666866.076465:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788666866.076524:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525090560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.076531:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788666866.076594:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666866.076643:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525090560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666866.078543:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666866.078564:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525090688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666866.078640:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666866.078695:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525091072:0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.078701:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525090944:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.078724:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666866.078756:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525091584:0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.078758:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666866.078791:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666866.078799:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525091456:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.078814:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875552525092096:0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.078826:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666866.078860:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875552525091968:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.078870:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666866.078888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666866.078894:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788666866.078905:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525091200:0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.078911:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788666866.078919:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525090816:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.078935:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666866.078951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666866.079000:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525091072 00000100:00100000:2.0:1788666866.079008:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525091072 00000100:00100000:3.0:1788666866.079013:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525091584 00000100:00100000:3.0:1788666866.079019:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525091584 00000100:00100000:3.0:1788666866.079059:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525091456 00000100:00100000:3.0:1788666866.079062:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525091456 00000100:00100000:2.0:1788666866.079067:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666866.079080:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525091584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666866.079086:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666866.079096:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525091072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.083936:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525091712:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.084008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666866.084042:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525092224:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.084063:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666866.084099:0:24938:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788666866.084107:0:24938:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788666866.084195:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525090688 00000100:00100000:1.0:1788666866.084204:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525090688 00000100:00100000:1.0:1788666866.084254:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666866.084264:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875552525090688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666866.084289:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666866.084349:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875552525090688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (5711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.084357:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666866.084407:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525090688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666866.084434:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525092096 00000100:00100000:1.0:1788666866.084437:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525092096 00000100:00100000:1.0:1788666866.084461:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525091968 00000100:00100000:1.0:1788666866.084464:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525091968 00000100:00100000:1.0:1788666866.084478:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525091200 00000100:00100000:1.0:1788666866.084480:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525091200 00000100:00100000:1.0:1788666866.084493:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525091712 00000100:00100000:1.0:1788666866.084495:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525091712 00000100:00100000:1.0:1788666866.084505:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525092224 00000100:00100000:1.0:1788666866.084508:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525092224 00000100:00100000:1.0:1788666866.084525:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788666866.084531:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707f603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875552525092096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.084570:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875552525092096:12345-0@lo:400:kworker.0 Request processed in 39us (5701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.084576:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788666866.084589:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788666866.084596:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875552525091968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.086065:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875552525091968:12345-0@lo:400:kworker.0 Request processed in 1459us (7166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.086083:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788666866.086121:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788666866.086135:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525091200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.086493:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875552525091200:12345-0@lo:400:kworker.0 Request processed in 360us (7554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.086521:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788666866.086549:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788666866.086648:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937074ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525091712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.086681:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937074ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875552525091712:12345-0@lo:400:kworker.0 Request processed in 124us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.086687:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788666866.086699:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666866.086710:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875552525092224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.086772:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875552525092224:12345-0@lo:400:kworker.0 Request processed in 64us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.086781:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666866.086984:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875552525091200:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.087009:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875552525091712:0@lo:400:kworker.0 00010000:00080000:1.0:1788666866.087028:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937072f56a00 x1875552525092224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666866.087042:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875552525092224:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.087061:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875552525092096:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.087147:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788666866.087163:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525091456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.087514:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525091456:12345-0@lo:400:kworker.0 Request processed in 356us (8685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.087524:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788666866.087770:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525090816 00000100:00100000:1.0:1788666866.087776:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525090816 00000100:00100000:1.0:1788666866.087816:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788666866.087823:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:3641:x1875552525090816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.087855:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525091328:0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.087895:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666866.087920:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875552525091840:0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.087947:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666866.087980:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:3641:x1875552525090816:12345-0@lo:400:kworker.0 Request processed in 155us (9026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666866.087988:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525091456:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.087989:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:0.0:1788666866.088009:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff937072f57800 x1875552525091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666866.088021:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875552525091968:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.088033:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525090944 00000100:00100000:1.0:1788666866.088038:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525090944 00000100:00100000:0.0:1788666866.088042:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525090816:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.088067:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525091328 00000100:00100000:1.0:1788666866.088071:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525091328 00000100:00100000:0.0:1788666866.088072:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525091840 00000100:00100000:0.0:1788666866.088085:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525091840 00000100:00100000:1.0:1788666866.088089:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788666866.088098:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525090944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.088120:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788666866.088131:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875552525091840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.088143:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525090944:12345-0@lo:400:kworker.0 Request processed in 47us (9387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.088151:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788666866.088168:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788666866.088174:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875552525091840:12345-0@lo:400:kworker.0 Request processed in 45us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666866.088183:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788666866.088336:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525091328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.088371:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875552525091840:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.088378:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525091328:12345-0@lo:400:kworker.0 Request processed in 201us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666866.088387:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788666866.088394:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525090944:0@lo:400:kworker.0 00000100:00100000:0.0:1788666866.088413:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525091328:0@lo:400:kworker.0 00000100:00080000:1.0:1788666866.088488:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788666866.088492:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666866.088496:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666866.088725:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525091584:12345-0@lo:400:kworker.0 Request processed in 9648us (9934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666866.088734:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788666866.088886:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707f603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525091072:12345-0@lo:400:kworker.0 Request processed in 9790us (10160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666866.088895:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788666866.088947:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525091072:0@lo:400:kworker.0 00000100:00100000:1.0:1788666866.088960:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525091584:0@lo:400:kworker.0 00010000:00010000:0.0:1788666866.332021:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788666867.107214:0:24258:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b1ad00b0-8834-4215-915b-cc506c1c34f5 00000001:00100000:3.0:1788666867.107229:0:24258:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1e410e58-9219-4ec8-a46c-3adbd93f4c9d 00000001:00100000:0.0:1788666867.107667:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b1ad00b0-8834-4215-915b-cc506c1c34f5 00000001:00100000:0.0:1788666867.107682:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1e410e58-9219-4ec8-a46c-3adbd93f4c9d 00010000:00010000:3.0:1788666867.358022:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666867.612093:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525092352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788666867.612173:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666867.612255:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525092352 00000100:00100000:1.0:1788666867.612270:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525092352 00000100:00100000:1.0:1788666867.612323:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666867.612332:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525092352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788666867.612362:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666867.612416:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525092352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666867.612423:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666867.612807:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525092352:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788666867.740658:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788666868.388009:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666868.641214:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666868.641238:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525092480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788666868.641311:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666868.641479:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525092480 00000100:00100000:3.0:1788666868.641488:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525092480 00000100:00100000:3.0:1788666868.641549:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788666868.641558:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525092480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788666868.641594:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788666868.641647:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525092480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666868.641668:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788666868.641709:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525092480:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788666868.772529:0:25637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788666869.148025:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666869.148046:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525092608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788666869.148111:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666869.148177:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525092608 00000100:00100000:1.0:1788666869.148184:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525092608 00000100:00100000:1.0:1788666869.148230:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788666869.148239:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525092608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788666869.148273:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788666869.148340:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525092608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666869.148348:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788666869.148500:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525092608:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788666869.150747:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b1ad00b0-8834-4215-915b-cc506c1c34f5 00000001:00100000:0.0:1788666869.150765:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1e410e58-9219-4ec8-a46c-3adbd93f4c9d 00000001:00100000:3.0:1788666869.150865:0:22738:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b1ad00b0-8834-4215-915b-cc506c1c34f5 00000001:00100000:3.0:1788666869.150873:0:22738:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1e410e58-9219-4ec8-a46c-3adbd93f4c9d 00010000:00010000:0.0:1788666869.404515:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788666869.929085:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788666870.172527:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666870.172551:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525092736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788666870.172625:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666870.172752:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525092736 00000100:00100000:1.0:1788666870.172761:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525092736 00000100:00100000:1.0:1788666870.172821:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788666870.172863:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93705dd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525092736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788666870.172894:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788666870.172939:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93705dd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525092736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666870.172946:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788666870.173019:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666870.173058:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f436e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525092736:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788666870.428297:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666871.059110:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059157:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059198:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059219:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059233:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059248:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059263:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059278:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059311:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666871.059336:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505061888 00000100:00100000:1.0:1788666871.059344:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505061888 00000100:00100000:1.0:1788666871.059632:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505062400 00000100:00100000:1.0:1788666871.059636:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505062400 00000100:00100000:1.0:1788666871.059653:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505061760 00000100:00100000:1.0:1788666871.059655:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505061760 00000100:00100000:1.0:1788666871.059668:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505062272 00000100:00100000:1.0:1788666871.059671:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505062272 00000100:00100000:1.0:1788666871.059688:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:1.0:1788666871.059697:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2396:x1875552505061888:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666871.059773:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2396:x1875552505061888:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 76us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.059780:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:1.0:1788666871.059807:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:1.0:1788666871.059814:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2396:x1875552505062400:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666871.059858:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2396:x1875552505062400:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 44us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.059864:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:1.0:1788666871.059877:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 9 00000100:00100000:1.0:1788666871.059892:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2396:x1875552505061760:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666871.059919:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2396:x1875552505061760:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.059925:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 9 00000100:00100000:1.0:1788666871.059937:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 10 00000100:00100000:1.0:1788666871.059943:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2396:x1875552505062272:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666871.059964:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2396:x1875552505062272:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 22us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.059970:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 10 00000100:00100000:1.0:1788666871.059990:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505061632 00000100:00100000:1.0:1788666871.059993:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505061632 00000100:00100000:1.0:1788666871.060012:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505062144 00000100:00100000:1.0:1788666871.060015:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505062144 00000100:00100000:1.0:1788666871.060027:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505061504 00000100:00100000:1.0:1788666871.060029:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505061504 00000100:00100000:1.0:1788666871.060041:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505062016 00000100:00100000:1.0:1788666871.060043:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505062016 00000100:00100000:1.0:1788666871.060056:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 43 00000100:00100000:1.0:1788666871.060062:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2396:x1875552505061632:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666871.060089:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2396:x1875552505061632:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 26us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.060095:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 43 00000100:00100000:1.0:1788666871.060108:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 44 00000100:00100000:1.0:1788666871.060115:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2396:x1875552505062144:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666871.060152:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2396:x1875552505062144:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 38us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.060236:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 44 00000100:00100000:1.0:1788666871.060250:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 45 00000100:00100000:1.0:1788666871.060257:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2396:x1875552505061504:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666871.060282:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2396:x1875552505061504:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 26us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.060288:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 45 00000100:00100000:1.0:1788666871.060300:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 46 00000100:00100000:1.0:1788666871.060306:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2396:x1875552505062016:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666871.060328:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2396:x1875552505062016:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 23us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.060335:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 46 00000100:00100000:3.0:1788666871.060740:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505061376 00000100:00100000:3.0:1788666871.060746:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505061376 00000100:00100000:3.0:1788666871.060782:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 145 00000100:00100000:3.0:1788666871.060789:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+13:2396:x1875552505061376:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666871.060816:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+13:2396:x1875552505061376:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 27us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666871.060822:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 145 00000100:00080000:2.0:1788666871.060999:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788666871.061005:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788666871.061009:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666871.061011:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666871.201154:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525093120:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.201224:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666871.201276:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525093632:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.201299:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666871.201318:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525094144:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.201343:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666871.201367:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788666871.201374:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525093248:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.201398:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666871.201418:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525093760:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.201439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666871.201469:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525094272:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.201496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666871.201528:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525093120 00000100:00100000:1.0:1788666871.202101:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525092992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666871.202136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666871.202160:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525093504:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.202183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666871.202200:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875552525094016:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.202219:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666871.202236:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875552525094528:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.202256:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666871.202269:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788666871.202276:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525092864:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.202303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666871.202329:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525093376:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.202358:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666871.202376:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525093888:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.202394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666871.202410:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93705dd56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875552525094400:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.202430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666871.202458:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525092992 00000100:00100000:1.0:1788666871.202464:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525092992 00000100:00100000:1.0:1788666871.202519:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666871.202528:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525092992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666871.202870:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666871.202883:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525094656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666871.202997:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666871.203030:0:24265:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788666871.203038:0:24265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788666871.203464:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525094656 00000100:00100000:0.0:1788666871.203471:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525094656 00000100:00100000:2.0:1788666871.203647:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525093120 00000100:00100000:2.0:1788666871.203683:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525093632 00000100:00100000:2.0:1788666871.203686:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525093632 00000100:00100000:2.0:1788666871.203701:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00002000:00000024:1.0:1788666871.204892:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788666871.205115:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525092992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2586us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205126:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666871.205162:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666871.205176:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525094656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666871.205197:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666871.205234:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525094656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205240:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666871.205269:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525094144 00000100:00100000:1.0:1788666871.205276:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525094144 00000100:00100000:1.0:1788666871.205311:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525094272 00000100:00100000:1.0:1788666871.205314:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525094272 00000100:00100000:1.0:1788666871.205328:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525093504 00000100:00100000:1.0:1788666871.205331:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525093504 00000100:00100000:1.0:1788666871.205341:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525094016 00000100:00100000:1.0:1788666871.205344:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525094016 00000100:00100000:1.0:1788666871.205368:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525094528 00000100:00100000:1.0:1788666871.205372:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525094528 00000100:00100000:1.0:1788666871.205384:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525094400 00000100:00100000:1.0:1788666871.205387:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525094400 00000100:00100000:1.0:1788666871.205402:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788666871.205408:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93705dd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525094144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.205445:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93705dd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875552525094144:12345-0@lo:400:kworker.0 Request processed in 37us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205452:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788666871.205464:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788666871.205471:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525094272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.205499:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875552525094272:12345-0@lo:400:kworker.0 Request processed in 29us (4003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205505:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788666871.205517:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788666871.205522:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525093504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.205562:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875552525093504:12345-0@lo:400:kworker.0 Request processed in 41us (3378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205568:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788666871.205579:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788666871.205585:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875552525094016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.205609:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875552525094016:12345-0@lo:400:kworker.0 Request processed in 24us (3389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205615:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788666871.205626:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788666871.205632:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875552525094528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.205670:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875552525094528:12345-0@lo:400:kworker.0 Request processed in 38us (3412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205676:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788666871.205688:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788666871.205694:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875552525094400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.205734:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875552525094400:12345-0@lo:400:kworker.0 Request processed in 40us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205740:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788666871.205763:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525092864 00000100:00100000:1.0:1788666871.205767:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525092864 00000100:00100000:1.0:1788666871.205797:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788666871.205804:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:3641:x1875552525092864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.205861:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:3641:x1875552525092864:12345-0@lo:400:kworker.0 Request processed in 30us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.205868:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788666871.205899:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525093248 00000100:00100000:1.0:1788666871.205902:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525093248 00000100:00100000:2.0:1788666871.206151:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93705dd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525093120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.206197:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93705dd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525093120:12345-0@lo:400:kworker.0 Request processed in 2490us (4974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666871.206204:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788666871.206222:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788666871.206229:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93705dd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525093632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.206254:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93705dd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525093632:12345-0@lo:400:kworker.0 Request processed in 27us (4955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666871.206260:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788666871.206286:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525093760 00000100:00100000:2.0:1788666871.206290:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525093760 00000100:00100000:2.0:1788666871.206318:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525093376 00000100:00100000:2.0:1788666871.206322:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525093376 00000100:00100000:2.0:1788666871.206333:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525093888 00000100:00100000:2.0:1788666871.206335:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525093888 00000100:00100000:2.0:1788666871.206346:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666871.206351:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.206380:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525093760:12345-0@lo:400:kworker.0 Request processed in 28us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666871.206385:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666871.206396:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666871.206411:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525093376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.206441:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875552525093376:12345-0@lo:400:kworker.0 Request processed in 31us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666871.206445:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666871.206456:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666871.206461:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525093888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.206487:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875552525093888:12345-0@lo:400:kworker.0 Request processed in 26us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666871.206492:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788666871.206992:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788666871.206997:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788666871.207000:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666871.207002:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666871.207278:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525093760:0@lo:400:kworker.0 00010000:00080000:2.0:1788666871.207296:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93705dd55f80 x1875552525094272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666871.207308:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875552525094272:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.207320:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525093120:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.207331:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525093632:0@lo:400:kworker.0 00000100:00100000:2.0:1788666871.207343:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875552525094144:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.207557:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666871.207566:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93705dd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525093248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.207625:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93705dd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525093248:12345-0@lo:400:kworker.0 Request processed in 61us (6226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666871.207631:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666871.207663:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525092864:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.207676:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525093376:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.207684:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875552525093888:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.207706:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875552525094400:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.207742:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875552525092992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666871.207755:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875552525093504:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.207764:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875552525094016:0@lo:400:kworker.0 00010000:00080000:1.0:1788666871.207775:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93705dd55180 x1875552525094528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666871.207784:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875552525094528:0@lo:400:kworker.0 00000100:00100000:1.0:1788666871.207862:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525094656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666871.207892:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93705dd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525093248:0@lo:400:kworker.0 00010000:00010000:2.0:1788666871.455288:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788666872.177429:0:25787:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe98b3cf90 20000000:00000080:2.0:1788666872.178804:0:25787:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9370755fd400 uarg=0000000000000000 20000000:01000000:2.0:1788666872.179169:0:25787:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788666872.179178:0:25787:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788666872.179200:0:25787:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788666872.180972:0:25788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788666872.181113:0:25787:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788666872.190972:0:25787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788666872.195209:0:25787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195242:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad46 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195250:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad54 expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195257:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ad93 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195264:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564ae2d expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195298:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195306:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195314:0:25787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195368:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195386:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 12 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.195404:0:25787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525094784:192.168.206.34@tcp:104: 00010000:00010000:3.0:1788666872.195585:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195593:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 12 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.195602:0:25787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42068a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525094912:192.168.206.34@tcp:104: 00010000:00010000:3.0:1788666872.195630:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ae2d expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195639:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ae2d expref: 23 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.195732:0:25787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525095040:0@lo:104: 00000100:00100000:3.0:1788666872.195781:0:25787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788666872.195890:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ad93 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.195899:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ad93 expref: 23 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.195907:0:25787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525095168:0@lo:104: 00000100:00100000:3.0:1788666872.195929:0:25787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666872.206415:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525095040 00000100:00100000:2.0:1788666872.206442:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525095040 00000100:00100000:1.0:1788666872.207232:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525095168 00000100:00100000:1.0:1788666872.207245:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525095168 00000100:00100000:1.0:1788666872.207295:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788666872.207307:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+4:25787:x1875552525095040:12345-0@lo:104: 00010000:00010000:1.0:1788666872.207332:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.207474:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788666872.207481:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+4:25787:x1875552525095040:12345-0@lo:104: Request processed in 177us (11700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666872.207490:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788666872.207515:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666872.207522:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:25787:x1875552525095168:12345-0@lo:104: 00010000:00010000:1.0:1788666872.207531:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.207544:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666872.207552:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.207565:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a2a00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788666872.207570:0:24288:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.207579:0:24288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666872.207587:0:24288:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.207592:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1788666872.207593:0:24288:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788666872.207596:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:25787:x1875552525095168:12345-0@lo:104: Request processed in 76us (11668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666872.207602:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788666872.207623:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666872.207627:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.207633:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a2400 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666872.207636:0:22746:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.207641:0:24288:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.207643:0:22746:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.207647:0:24288:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666872.207670:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.207678:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a2a00/0x4267b949b564ae2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ae34 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.207696:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666872.207699:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666872.207700:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666872.207739:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525095296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666872.207788:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666872.207891:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525095296 00000100:00100000:0.0:1788666872.207895:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525095296 00010000:00010000:0.0:1788666872.207921:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ae2d expref: 24 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666872.207952:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666872.207959:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a62c9863-c7b0-471d-812b-42670ca06572+24:3639:x1875552525095296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666872.207973:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666872.207979:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ae2d expref: 24 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.207990:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ae2d expref: 24 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.208010:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666872.208037:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a62c9863-c7b0-471d-812b-42670ca06572+24:3639:x1875552525095296:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666872.208044:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666872.208085:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a62c9863-c7b0-471d-812b-42670ca06572:3639:1875552525095296:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1788666872.208765:0:22746:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666872.208772:0:22746:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788666872.208817:0:22746:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.208823:0:22746:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666872.208855:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.208861:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a2400/0x4267b949b564ad93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad9a expref: -99 pid: 24257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.208894:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666872.208896:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666872.208900:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666872.208918:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525095424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666872.208966:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666872.209048:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525095424 00000100:00100000:2.0:1788666872.209056:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525095424 00010000:00010000:2.0:1788666872.209086:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad93 expref: 24 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666872.209134:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788666872.209142:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a62c9863-c7b0-471d-812b-42670ca06572+24:3640:x1875552525095424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666872.209155:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666872.209159:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad93 expref: 24 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666872.209169:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ad93 expref: 24 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666872.209197:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666872.209244:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a62c9863-c7b0-471d-812b-42670ca06572+24:3640:x1875552525095424:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666872.209253:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666872.209275:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525095424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666872.210573:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ad54 expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.210591:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ad54 expref: 23 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.210606:0:25787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525095552:0@lo:104: 00000100:00100000:3.0:1788666872.210671:0:25787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666872.210763:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525095552 00000100:00100000:2.0:1788666872.210774:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525095552 00000100:00100000:2.0:1788666872.210947:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788666872.210949:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4267b949b564ad46 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666872.210961:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:25787:x1875552525095552:12345-0@lo:104: 00010000:00010000:3.0:1788666872.210966:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4267b949b564ad46 expref: 23 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.210977:0:25787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42068e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525095680:0@lo:104: 00010000:00010000:2.0:1788666872.210980:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.211006:0:25787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666872.211080:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666872.211087:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:25787:x1875552525095552:12345-0@lo:104: Request processed in 130us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666872.211106:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788666872.211150:0:22747:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666872.211162:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.211172:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93706f7a2c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:1.0:1788666872.211176:0:22747:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.211185:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666872.211193:0:22747:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666872.211198:0:22747:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788666872.211237:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.211244:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666872.211262:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.211281:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff93706f7a2c00/0x4267b949b564ad54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad5b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.211297:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666872.211299:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666872.211300:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666872.211315:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525095808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666872.211345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666872.215041:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525095808 00000100:00100000:1.0:1788666872.215062:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525095808 00010000:00010000:1.0:1788666872.215147:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad54 expref: 24 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666872.215208:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666872.215219:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+24:3641:x1875552525095808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666872.215240:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666872.215246:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad54 expref: 24 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.215258:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ad54 expref: 24 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.215283:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666872.215394:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+24:3641:x1875552525095808:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (4047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666872.215402:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666872.215462:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a62c9863-c7b0-471d-812b-42670ca06572:3641:1875552525095808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666872.217135:0:25787:0:(client.c:2716:ptlrpc_set_wait()) set ffff937041254d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666872.217197:0:25787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525094784:192.168.206.34@tcp:104: 00000100:00100000:3.0:1788666872.217229:0:25787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42068a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525094912:192.168.206.34@tcp:104: 00010000:00010000:3.0:1788666872.217244:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff937040031a00/0x4267b949b564ae34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ae2d expref: 23 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.217262:0:25787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525095040:0@lo:104: 00010000:00010000:3.0:1788666872.217281:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f9e00/0x4267b949b564ad9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ad93 expref: 22 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.217289:0:25787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525095168:0@lo:104: 00010000:00010000:3.0:1788666872.217300:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f8e00/0x4267b949b564ad5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ad54 expref: 21 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.217307:0:25787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525095552:0@lo:104: 00000100:00100000:2.0:1788666872.218878:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525095680 00000100:00100000:2.0:1788666872.218899:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525095680 00000100:00100000:2.0:1788666872.218962:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666872.218973:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:25787:x1875552525095680:12345-0@lo:104: 00010000:00010000:2.0:1788666872.218994:0:22741:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666872.225218:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666872.225294:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505062656 00000100:00100000:3.0:1788666872.225317:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505062656 00010000:00010000:3.0:1788666872.225373:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 13 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.225421:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 12 00000100:00100000:3.0:1788666872.225433:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42372aab-04b6-4821-a139-fec1a872a41d+13:2396:x1875552505062656:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666872.225453:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666872.225459:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 13 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666872.225470:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00010000:00010000:3.0:1788666872.225477:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 13 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.225502:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370582f9200/0x4267b949b564b080 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52e74 expref: 13 pid: 22752 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.225539:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666872.225543:0:22741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788666872.225553:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a62c9863-c7b0-471d-812b-42670ca06572+3:25787:x1875552525095680:12345-0@lo:104: Request processed in 6580us (14545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666872.225564:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788666872.225594:0:24288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788666872.225600:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42372aab-04b6-4821-a139-fec1a872a41d+12:2396:x1875552505062656:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 168us (397us total) trans 0 rc 0/0 00010000:00010000:0.0:1788666872.225603:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.225610:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 12 00010000:00010000:0.0:1788666872.225619:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370582f9c00 already unused, calling callback (ffffffffc1461c20) 10000000:00010000:0.0:1788666872.225625:0:24288:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.225630:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505062528 00000100:00100000:3.0:1788666872.225635:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505062528 00010000:00010000:3.0:1788666872.225660:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 12 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666872.225674:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 13 00000100:00100000:3.0:1788666872.225681:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4301cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42372aab-04b6-4821-a139-fec1a872a41d+12:2397:x1875552505062528:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666872.225689:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666872.225696:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 12 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.225700:0:24288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666872.225721:0:24288:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.225722:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 12 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666872.225739:0:24288:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788666872.225747:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9370474c8a00/0x4267b949b564b0bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ee4 expref: 12 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666872.225767:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666872.225779:0:24288:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.225788:0:24288:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788666872.225791:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4301cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42372aab-04b6-4821-a139-fec1a872a41d+11:2397:x1875552505062528:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 109us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666872.225802:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 13 00010000:00010000:0.0:1788666872.225813:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.225822:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.134@tcp lock: ffff9370582f9c00/0x4267b949b564ad46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4267b949b564ad4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.225856:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666872.225858:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666872.225861:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666872.225877:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937072f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525095936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666872.225919:0:25787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42068e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875552525095680:0@lo:104: 00010000:00010000:3.0:1788666872.225964:0:25787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666872.226233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666872.226686:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525095936 00000100:00100000:1.0:1788666872.226693:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525095936 00010000:00010000:1.0:1788666872.226732:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad46 expref: 21 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666872.229208:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666872.229241:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+21:3638:x1875552525095936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666872.229270:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666872.229282:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4267b949b564ad46 expref: 21 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229329:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4267b949b564ad46 expref: 21 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229356:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93705d3e0400/0x4267b949b564ad4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4267b949b564ad46 expref: 21 pid: 22753 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229375:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229386:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229422:0:22744:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229430:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229436:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229443:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229450:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375f200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:0.0:1788666872.229454:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229464:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229509:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666872.229523:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666872.229633:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a62c9863-c7b0-471d-812b-42670ca06572+20:3638:x1875552525095936:12345-0@lo:103:ldlm_bl.0 Request processed in 410us (3400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666872.229642:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788666872.229742:0:25787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.229761:0:25787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666872.229768:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff936f4375f200/0x4267b949b564b0f0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666872.231039:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937072f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a62c9863-c7b0-471d-812b-42670ca06572:3638:1875552525095936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666872.476132:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666872.733035:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666872.733067:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525096064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788666872.733179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666872.733575:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525096064 00000100:00100000:3.0:1788666872.733586:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525096064 00000100:00100000:3.0:1788666872.733649:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666872.733660:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525096064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788666872.733695:0:24265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788666872.733775:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525096064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666872.733783:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666872.733871:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525096064:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788666873.500387:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666873.563898:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.564055:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505062784 00000100:00100000:2.0:1788666873.564068:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505062784 00000100:00100000:2.0:1788666873.564213:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 23 00000100:00100000:2.0:1788666873.564226:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:18707:x1875552505062784:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666873.564247:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666873.564269:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b0f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f1c expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564331:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564365:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564380:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564395:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564402:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564408:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564496:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8e00/0x4267b949b564b10c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564794:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8e00/0x4267b949b564b10c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564803:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8e00/0x4267b949b564b10c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666873.564872:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788666873.564876:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788666873.564943:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8e00/0x4267b949b564b10c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564955:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564971:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564978:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564984:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9000 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666873.564989:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.564996:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565009:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9370439b9d00) 00010000:00010000:2.0:1788666873.565012:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.565017:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565023:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b0fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565037:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565043:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565049:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565053:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666873.565062:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565068:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565075:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff936f42326400) 00010000:00010000:2.0:1788666873.565078:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.565080:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565086:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b105 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565123:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b0f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f1c expref: 8 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565136:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8e00/0x4267b949b564b10c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f1c expref: 7 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.565144:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff936f42326a00) 00010000:00010000:2.0:1788666873.565146:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666873.565148:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c8e00, rc 0) 00000100:00100000:2.0:1788666873.565239:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:18707:x1875552505062784:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 1015us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666873.565248:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 23 00000100:00080000:3.0:1788666873.566647:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666873.571516:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666873.571870:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505062912 00000100:00100000:0.0:1788666873.571881:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505062912 00000100:00100000:0.0:1788666873.571951:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 5 00000100:00100000:0.0:1788666873.571962:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:18707:x1875552505062912:12345-192.168.206.34@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788666873.572061:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:18707:x1875552505062912:12345-192.168.206.34@tcp:900:lhsmtool_posix.0 Request processed in 101us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666873.572070:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 5 00000100:00100000:0.0:1788666873.574434:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.574669:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505063168 00000100:00100000:2.0:1788666873.574686:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505063168 00000100:00100000:2.0:1788666873.574752:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 24 00000100:00100000:2.0:1788666873.574761:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:18707:x1875552505063168:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666873.574793:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666873.574812:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b113 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f23 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.574909:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.574924:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.574936:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.574950:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.574957:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.574964:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575080:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8600/0x4267b949b564b128 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575089:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8600/0x4267b949b564b128 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575097:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8600/0x4267b949b564b128 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666873.575106:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788666873.575376:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575390:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575396:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575407:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666873.575410:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575417:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575429:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff936f42326a00) 00010000:00010000:2.0:1788666873.575432:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.575436:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575441:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b11a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575452:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575458:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575463:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575477:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9000 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666873.575480:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575486:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575493:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff936f42326400) 00010000:00010000:2.0:1788666873.575495:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.575498:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.575714:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b121 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.576934:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b113 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f23 expref: 10 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.576957:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8600/0x4267b949b564b128 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f23 expref: 9 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.576965:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff936f42326900) 00010000:00010000:2.0:1788666873.576968:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.576971:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c8600, rc 0) 00000100:00100000:2.0:1788666873.577141:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:18707:x1875552505063168:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 2379us (2716us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788666873.577149:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 24 00000100:00100000:1.0:1788666873.584763:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.584869:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505063296 00000100:00100000:2.0:1788666873.584891:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505063296 00000100:00100000:2.0:1788666873.584950:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 25 00000100:00100000:2.0:1788666873.584961:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:18707:x1875552505063296:12345-192.168.206.34@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788666873.585075:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:18707:x1875552505063296:12345-192.168.206.34@tcp:59:lhsmtool_posix.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666873.585084:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 25 00000100:00100000:3.0:1788666873.586657:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666873.586737:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505063424 00000100:00100000:0.0:1788666873.586747:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505063424 00000100:00100000:0.0:1788666873.586817:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 26 00000100:00100000:0.0:1788666873.586828:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:18707:x1875552505063424:12345-192.168.206.34@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788666873.587694:0:25094:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 792us 00000100:00080000:3.0:1788666873.587785:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788666873.615451:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:18707:x1875552505063424:12345-192.168.206.34@tcp:59:lhsmtool_posix.0 Request processed in 28617us (28793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666873.615467:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 26 00000100:00100000:0.0:1788666873.626279:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.626393:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505063552 00000100:00100000:2.0:1788666873.626403:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505063552 00000100:00100000:2.0:1788666873.626465:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 27 00000100:00100000:2.0:1788666873.626475:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:18713:x1875552505063552:12345-192.168.206.34@tcp:101:lfs.0 00010000:00010000:2.0:1788666873.626495:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666873.626526:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f2a expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626587:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626602:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626614:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626690:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626699:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626736:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626777:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626784:0:22759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626791:0:22759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626796:0:22759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9000 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666873.626800:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626808:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626820:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9370439b9d00) 00010000:00010000:2.0:1788666873.626823:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.626828:0:22759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626863:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b13d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626875:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.626881:0:22759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.627145:0:22759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.627151:0:22759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666873.627154:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.627160:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.627169:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff936f42326400) 00010000:00010000:2.0:1788666873.627172:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.627175:0:22759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.627181:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9a00/0x4267b949b564b144 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.627216:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b136 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f2a expref: 10 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.627226:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9370439b9d00) 00010000:00010000:2.0:1788666873.627229:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.627233:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f2a expref: 10 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.627241:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c8400, rc 0) 00000100:00100000:2.0:1788666873.627368:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:18713:x1875552505063552:12345-192.168.206.34@tcp:101:lfs.0 Request processed in 893us (1097us total) trans 0 rc 301/301 00000100:00100000:2.0:1788666873.627384:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 27 00000100:00100000:3.0:1788666873.635021:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666873.635758:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505063680 00000100:00100000:1.0:1788666873.635769:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505063680 00000100:00100000:1.0:1788666873.636077:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 0 00000100:00100000:1.0:1788666873.636088:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:18713:x1875552505063680:12345-192.168.206.34@tcp:700:lfs.0 00000100:00100000:1.0:1788666873.636176:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:18713:x1875552505063680:12345-192.168.206.34@tcp:700:lfs.0 Request processed in 90us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666873.636183:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 0 00000100:00100000:2.0:1788666873.639647:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666873.639801:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505063936 00000100:00100000:1.0:1788666873.639811:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505063936 00000100:00100000:1.0:1788666873.640317:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 28 00000100:00100000:1.0:1788666873.640329:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:18713:x1875552505063936:12345-192.168.206.34@tcp:36:lfs.0 00010000:00010000:1.0:1788666873.640381:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666873.640408:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370582f9a00/0x4267b949b564b0aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52ea5 expref: 9 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.640427:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9370439b9d00) 00010000:00010000:1.0:1788666873.640433:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666873.640492:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.640506:0:22760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 5 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.640515:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.640559:0:22760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 5 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.640572:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 5 pid: 25094 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666873.640587:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075591c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1875552525096192:192.168.206.34@tcp:104: 00000100:00100000:1.0:1788666873.640667:0:22760:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370524c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666873.650302:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.650756:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505064064 00000100:00100000:2.0:1788666873.650765:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505064064 00010000:00010000:2.0:1788666873.650823:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 6 pid: 25094 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666873.650883:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 15 00000100:00100000:2.0:1788666873.650894:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2396:x1875552505064064:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666873.650921:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666873.650928:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 6 pid: 25094 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.650941:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 6 pid: 25094 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.650961:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9370439b9d00) 00010000:00010000:2.0:1788666873.650967:0:22743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.650976:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.650984:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.651002:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666873.651050:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2396:x1875552505064064:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 157us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666873.651080:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 15 00000100:00080000:3.0:1788666873.651141:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788666873.651952:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b0e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f15 expref: 5 pid: 25094 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666873.651983:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075591c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1875552525096192:192.168.206.34@tcp:104: 00010000:00010000:1.0:1788666873.652005:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.652015:0:22760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.652021:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.652042:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.652053:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.652062:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658121:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658146:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658469:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666873.658490:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a1e99cc reply state 0000000016814b2c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658513:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658520:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:1.0:1788666873.658523:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788666873.658527:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788666873.658535:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788666873.658544:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658550:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658557:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658563:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040030e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666873.658568:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658574:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658584:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9370439b9d00) 00010000:00010000:1.0:1788666873.658587:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666873.658590:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658595:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b14b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666873.658625:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a1e99cc reply state 0000000016814b2c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658634:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.658640:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9370439b9700) 00010000:00010000:1.0:1788666873.658642:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788666873.658644:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788666873.658754:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+10:18713:x1875552505063936:12345-192.168.206.34@tcp:36:lfs.0 Request processed in 18423us (19110us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788666873.658762:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 28 00000100:00100000:0.0:1788666873.740012:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.742438:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505064192 00000100:00100000:2.0:1788666873.742452:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505064192 00000100:00100000:3.0:1788666873.742647:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 29 00000100:00100000:3.0:1788666873.742660:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+10:18721:x1875552505064192:12345-192.168.206.34@tcp:101:lctl.0 00010000:00010000:3.0:1788666873.742683:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666873.742720:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e000/0x4267b949b564b160 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f31 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.742785:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ea00/0x4267b949b564b167 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.742798:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ea00/0x4267b949b564b167 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.742809:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ea00/0x4267b949b564b167 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666873.742889:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788666873.742893:0:22759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788666873.742926:0:22759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ea00/0x4267b949b564b167 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.742950:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e000/0x4267b949b564b160 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f31 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.742967:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ea00/0x4267b949b564b167 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f31 expref: 11 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.742976:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937042dd4d00) 00010000:00010000:3.0:1788666873.742979:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788666873.742983:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375ea00, rc 0) 00000100:00100000:3.0:1788666873.743717:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+11:18721:x1875552505064192:12345-192.168.206.34@tcp:101:lctl.0 Request processed in 1057us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666873.743726:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 29 00000100:00100000:1.0:1788666873.756079:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525096320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788666873.756150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666873.756247:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525096320 00000100:00100000:2.0:1788666873.756255:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525096320 00000100:00100000:2.0:1788666873.756318:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788666873.756327:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525096320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788666873.756358:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788666873.761360:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525096320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5023us (5198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666873.761374:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788666873.766487:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525096320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788666873.767227:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.768290:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505064320 00000100:00100000:2.0:1788666873.768302:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505064320 00000100:00100000:2.0:1788666873.768366:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 30 00000100:00100000:2.0:1788666873.768375:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:18722:x1875552505064320:12345-192.168.206.34@tcp:101:lfs.0 00010000:00010000:2.0:1788666873.768394:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666873.768415:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b16e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f38 expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.768476:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9400/0x4267b949b564b175 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.768491:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9400/0x4267b949b564b175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.768502:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9400/0x4267b949b564b175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666873.768772:0:25094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788666873.768777:0:25094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788666873.768802:0:25094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9400/0x4267b949b564b175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.768826:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b16e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f38 expref: 7 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.769165:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9400/0x4267b949b564b175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f38 expref: 6 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.769175:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937042dd4d00) 00010000:00010000:2.0:1788666873.769178:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666873.769181:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c9400, rc 0) 00000100:00100000:2.0:1788666873.769285:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18722:x1875552505064320:12345-192.168.206.34@tcp:101:lfs.0 Request processed in 911us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666873.769293:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 30 00000100:00100000:2.0:1788666873.774709:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666873.774936:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505064448 00000100:00100000:1.0:1788666873.774946:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505064448 00000100:00100000:1.0:1788666873.775010:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 31 00000100:00100000:1.0:1788666873.775019:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:18722:x1875552505064448:12345-192.168.206.34@tcp:101:lfs.0 00010000:00010000:1.0:1788666873.775116:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666873.775138:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b17c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f3f expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775198:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775213:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775239:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775252:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775259:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775266:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775332:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b191 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775340:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b191 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775347:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b191 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666873.775380:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788666873.775384:0:22758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788666873.775401:0:22758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b191 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775412:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775419:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775437:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775443:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666873.775446:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775455:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775465:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937042dd4d00) 00010000:00010000:1.0:1788666873.775468:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666873.775474:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775480:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775492:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775498:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775504:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775509:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666873.775512:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.775528:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.776280:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9370439b9700) 00010000:00010000:1.0:1788666873.776285:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666873.776292:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.776298:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b18a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.776332:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b17c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f3f expref: 8 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.776346:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b191 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f3f expref: 7 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.776353:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:1.0:1788666873.776355:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666873.776358:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040031200, rc 0) 00000100:00100000:1.0:1788666873.776661:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+7:18722:x1875552505064448:12345-192.168.206.34@tcp:101:lfs.0 Request processed in 1640us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666873.776669:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 31 00000100:00100000:0.0:1788666873.787799:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666873.789153:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505064576 00000100:00100000:1.0:1788666873.789226:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505064576 00000100:00100000:1.0:1788666873.789358:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 6 00000100:00100000:1.0:1788666873.789369:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:18722:x1875552505064576:12345-192.168.206.34@tcp:900:lfs.0 00000100:00100000:1.0:1788666873.789462:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:18722:x1875552505064576:12345-192.168.206.34@tcp:900:lfs.0 Request processed in 95us (1672us total) trans 0 rc 0/0 00000100:00080000:2.0:1788666873.790377:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788666873.790562:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 6 00000100:00100000:3.0:1788666873.794193:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666873.794399:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505064832 00000100:00100000:1.0:1788666873.794409:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505064832 00000100:00100000:1.0:1788666873.794470:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 32 00000100:00100000:1.0:1788666873.794480:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+7:18722:x1875552505064832:12345-192.168.206.34@tcp:101:lfs.0 00010000:00010000:1.0:1788666873.794499:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666873.794526:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f46 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666873.794625:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788666873.794731:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b198 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f46 expref: 9 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.794746:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937042dd4d00) 00010000:00010000:1.0:1788666873.794749:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666873.794754:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f46 expref: 9 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.794766:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040030e00, rc 0) 00000100:00100000:1.0:1788666873.794826:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+8:18722:x1875552505064832:12345-192.168.206.34@tcp:101:lfs.0 Request processed in 347us (641us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1788666873.794874:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 32 00000100:00100000:3.0:1788666873.797586:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666873.797772:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505065088 00000100:00100000:1.0:1788666873.797781:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505065088 00000100:00100000:1.0:1788666873.797863:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 33 00000100:00100000:1.0:1788666873.797886:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+8:18722:x1875552505065088:12345-192.168.206.34@tcp:36:lfs.0 00010000:00010000:1.0:1788666873.797939:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666873.797963:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b191 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f3f expref: 8 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.797980:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:1.0:1788666873.797985:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666873.798005:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.798018:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.798027:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666873.798222:0:22759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4399e7c reply state 00000000f855474c transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.798235:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.798242:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:1.0:1788666873.798245:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788666873.798247:0:22759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788666873.798254:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788666873.798321:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+9:18722:x1875552505065088:12345-192.168.206.34@tcp:36:lfs.0 Request processed in 437us (742us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788666873.798329:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 33 00000100:00100000:0.0:1788666873.802175:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.802360:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505065344 00000100:00100000:2.0:1788666873.802369:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505065344 00000100:00100000:2.0:1788666873.802438:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 2 00000100:00100000:2.0:1788666873.802448:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+9:18722:x1875552505065344:12345-192.168.206.34@tcp:35:lfs.0 00000100:00100000:2.0:1788666873.802675:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+10:18722:x1875552505065344:12345-192.168.206.34@tcp:35:lfs.0 Request processed in 228us (507us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788666873.802683:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 2 00000100:00100000:1.0:1788666873.806097:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.806253:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505065600 00000100:00100000:2.0:1788666873.806263:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505065600 00000100:00100000:2.0:1788666873.806323:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 34 00000100:00100000:2.0:1788666873.806333:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+10:18722:x1875552505065600:12345-192.168.206.34@tcp:101:lfs.0 00010000:00010000:2.0:1788666873.806358:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666873.806378:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b1ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f4d expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.806446:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.806459:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.806471:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.806482:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.806489:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.806495:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666873.806947:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788666873.807020:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807028:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807114:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807120:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9e00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666873.807123:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807131:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807142:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937042dd4d00) 00010000:00010000:2.0:1788666873.807146:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.807150:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807157:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9e00/0x4267b949b564b1b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807233:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807239:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807245:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807250:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8000 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666873.807253:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807269:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807278:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9370439b9700) 00010000:00010000:2.0:1788666873.807280:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666873.807283:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807289:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807325:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b1ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f4d expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807335:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937042dd4d00) 00010000:00010000:2.0:1788666873.807337:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666873.807341:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b1ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f4d expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.807349:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c9000, rc 0) 00000100:00100000:2.0:1788666873.807414:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+11:18722:x1875552505065600:12345-192.168.206.34@tcp:101:lfs.0 Request processed in 1082us (1325us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788666873.807422:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 34 00000100:00100000:0.0:1788666873.811966:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666873.812252:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505065728 00000100:00100000:1.0:1788666873.812265:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505065728 00000100:00100000:1.0:1788666873.812380:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 35 00000100:00100000:1.0:1788666873.812391:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+11:18722:x1875552505065728:12345-192.168.206.34@tcp:101:lfs.0 00010000:00010000:1.0:1788666873.812424:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666873.812442:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b1c9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f54 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.812545:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.812561:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.812574:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666873.812602:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788666873.812606:0:22759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788666873.812632:0:22759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.812659:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b1c9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 13 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.812675:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.812684:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:1.0:1788666873.812687:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666873.812716:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040030e00, rc 0) 00000100:00100000:1.0:1788666873.812870:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+12:18722:x1875552505065728:12345-192.168.206.34@tcp:101:lfs.0 Request processed in 480us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666873.812878:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 35 00000100:00100000:0.0:1788666873.820278:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.820414:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505065856 00000100:00100000:2.0:1788666873.820424:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505065856 00000100:00100000:2.0:1788666873.820528:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 3 00000100:00100000:2.0:1788666873.820539:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+12:18722:x1875552505065856:12345-192.168.206.34@tcp:37:lfs.0 00000100:00100000:2.0:1788666873.832969:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+12:18722:x1875552505065856:12345-192.168.206.34@tcp:37:lfs.0 Request processed in 12419us (12686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666873.832982:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 3 00000100:00100000:0.0:1788666873.838410:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666873.838583:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505066112 00000100:00100000:3.0:1788666873.838593:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505066112 00000100:00100000:3.0:1788666873.838648:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 4 00000100:00100000:3.0:1788666873.838658:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707c73cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+12:18722:x1875552505066112:12345-192.168.206.34@tcp:35:lfs.0 00000100:00100000:3.0:1788666873.838902:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707c73cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1ad00b0-8834-4215-915b-cc506c1c34f5+13:18722:x1875552505066112:12345-192.168.206.34@tcp:35:lfs.0 Request processed in 245us (499us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788666873.839361:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 4 00000100:00100000:0.0:1788666873.880755:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666873.880870:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505066240 00000100:00100000:3.0:1788666873.880880:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505066240 00000100:00100000:3.0:1788666873.880938:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 36 00000100:00100000:3.0:1788666873.880948:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+11:18728:x1875552505066240:12345-192.168.206.34@tcp:101:bash.0 00010000:00010000:3.0:1788666873.880966:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666873.880984:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e000/0x4267b949b564b1d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f5b expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881039:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881052:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881062:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881074:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881081:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881087:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881167:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f600/0x4267b949b564b1ec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881187:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f600/0x4267b949b564b1ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881195:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f600/0x4267b949b564b1ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666873.881227:0:25094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788666873.881232:0:25094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788666873.881268:0:25094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f600/0x4267b949b564b1ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881279:0:25094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881286:0:25094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881292:0:25094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881298:0:25094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e600 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1788666873.881302:0:25094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881309:0:25094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881319:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937042dd4d00) 00010000:00010000:3.0:1788666873.881322:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666873.881326:0:25094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881342:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e600/0x4267b949b564b1de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881354:0:25094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881359:0:25094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881365:0:25094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881370:0:25094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375f200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1788666873.881373:0:25094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881379:0:25094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881385:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9370439b9700) 00010000:00010000:3.0:1788666873.881387:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666873.881390:0:25094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881395:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b1e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881431:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e000/0x4267b949b564b1d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f5b expref: 13 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881452:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f600/0x4267b949b564b1ec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f5b expref: 12 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.881460:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:3.0:1788666873.881462:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788666873.881464:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375f600, rc 0) 00000100:00100000:3.0:1788666873.881510:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+12:18728:x1875552505066240:12345-192.168.206.34@tcp:101:bash.0 Request processed in 564us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666873.881527:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 36 00000040:00080000:1.0:1788666873.887374:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788666873.887971:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.888068:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505066368 00000100:00100000:2.0:1788666873.888077:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505066368 00000100:00100000:2.0:1788666873.888131:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:2.0:1788666873.888142:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:18728:x1875552505066368:12345-192.168.206.34@tcp:900:bash.0 00000100:00100000:2.0:1788666873.888232:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:18728:x1875552505066368:12345-192.168.206.34@tcp:900:bash.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666873.888241:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:0.0:1788666873.898206:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.898303:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505066624 00000100:00100000:2.0:1788666873.898312:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505066624 00000100:00100000:2.0:1788666873.898371:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 37 00000100:00100000:2.0:1788666873.898382:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+12:18728:x1875552505066624:12345-192.168.206.34@tcp:101:bash.0 00010000:00010000:2.0:1788666873.898402:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666873.898421:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b1f3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f62 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.898518:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.898543:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.898551:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.898600:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.898614:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 12 pid: 22759 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666873.898639:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4441c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22758:1875552525096448:192.168.206.34@tcp:104: 00000100:00100000:2.0:1788666873.898927:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042abc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666873.902689:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4441c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22758:1875552525096448:192.168.206.34@tcp:104: 00010000:00010000:2.0:1788666873.902727:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666873.904357:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.904535:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505066752 00000100:00100000:2.0:1788666873.904546:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505066752 00010000:00010000:2.0:1788666873.904593:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 13 pid: 22759 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666873.904768:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 16 00000100:00100000:2.0:1788666873.904779:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937072f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+13:2397:x1875552505066752:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666873.904814:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666873.904821:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 13 pid: 22759 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.904855:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 13 pid: 22759 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.904888:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040030e00/0x4267b949b564b1d0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f54 expref: 13 pid: 22759 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.904903:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:2.0:1788666873.904908:0:22744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.904917:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.904924:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666873.904956:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666873.905072:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+12:2397:x1875552505066752:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 294us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666873.905080:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 16 00010000:00010000:1.0:1788666873.905107:0:22758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905115:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905190:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905200:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905209:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905644:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905653:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905661:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666873.905670:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788666873.905694:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905725:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905732:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905737:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8000 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666873.905742:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905748:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905757:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:1.0:1788666873.905760:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666873.905763:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905769:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8000/0x4267b949b564b1fa lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666873.905782:0:22758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff27528b reply state 00000000f0bf4455 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905792:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905798:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9370439b9d00) 00010000:00010000:1.0:1788666873.905800:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788666873.905803:0:22758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788666873.905882:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9000/0x4267b949b564b1f3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 15 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905904:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 14 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666873.905912:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:1.0:1788666873.905914:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788666873.905916:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040031800, rc 0) 00000100:00100000:1.0:1788666873.905962:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937072f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+15:18728:x1875552505066624:12345-192.168.206.34@tcp:101:bash.0 Request processed in 7583us (7764us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788666873.905969:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 37 00000100:00100000:0.0:1788666873.918594:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666873.918753:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505066880 00000100:00100000:3.0:1788666873.918763:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505066880 00000100:00100000:3.0:1788666873.918823:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 38 00000100:00100000:3.0:1788666873.918866:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+15:18728:x1875552505066880:12345-192.168.206.34@tcp:101:bash.0 00010000:00010000:3.0:1788666873.918892:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666873.918911:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e000/0x4267b949b564b216 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f69 expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.918973:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.918988:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.919000:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666873.919046:0:25094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788666873.919063:0:25094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788666873.919085:0:25094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.919096:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.919119:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e000/0x4267b949b564b216 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 17 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.919135:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 16 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666873.919143:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666873.919160:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666873.919164:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375f200, rc 0) 00000100:00100000:3.0:1788666873.919209:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+16:18728:x1875552505066880:12345-192.168.206.34@tcp:101:bash.0 Request processed in 378us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666873.919216:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 38 00000100:00100000:0.0:1788666873.933629:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666873.933790:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505067136 00000100:00100000:2.0:1788666873.933799:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505067136 00000100:00100000:2.0:1788666873.933885:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 5 00000100:00100000:2.0:1788666873.933897:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+16:18728:x1875552505067136:12345-192.168.206.34@tcp:35:bash.0 00000100:00100000:2.0:1788666873.934202:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+17:18728:x1875552505067136:12345-192.168.206.34@tcp:35:bash.0 Request processed in 307us (593us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788666873.934210:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 5 00000040:00080000:3.0:1788666874.015646:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788666874.043503:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.043968:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505067392 00000100:00100000:1.0:1788666874.043980:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505067392 00000100:00100000:1.0:1788666874.044061:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 39 00000100:00100000:1.0:1788666874.044075:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+17:18738:x1875552505067392:12345-192.168.206.34@tcp:101:lfs.0 00010000:00010000:1.0:1788666874.044103:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666874.044124:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f70 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666874.044234:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788666874.044352:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b224 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f70 expref: 19 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.044369:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff937042dd4d00) 00010000:00010000:1.0:1788666874.044373:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666874.044379:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f70 expref: 19 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.044411:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937040031000, rc 0) 00000100:00100000:1.0:1788666874.044645:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+18:18738:x1875552505067392:12345-192.168.206.34@tcp:101:lfs.0 Request processed in 571us (1155us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788666874.044653:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 39 00000100:00100000:0.0:1788666874.055923:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.058603:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505067648 00000100:00100000:1.0:1788666874.058618:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505067648 00000100:00100000:1.0:1788666874.058770:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 6 00000100:00100000:1.0:1788666874.058782:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+18:18738:x1875552505067648:12345-192.168.206.34@tcp:35:lfs.0 00000100:00100000:1.0:1788666874.059039:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+19:18738:x1875552505067648:12345-192.168.206.34@tcp:35:lfs.0 Request processed in 259us (3125us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788666874.059047:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 6 00000100:00100000:0.0:1788666874.062949:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.063029:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505067776 00000100:00100000:3.0:1788666874.063038:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505067776 00000100:00100000:3.0:1788666874.063089:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 147 00000100:00100000:3.0:1788666874.063098:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+11:18091:x1875552505067776:12345-192.168.206.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666874.063113:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666874.063129:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff936f4375e000/0x4267b949b564b232 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f77 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.063167:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff936f4375e000/0x4267b949b564b232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f77 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.063190:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff936f4375e000/0x4267b949b564b232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f77 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.063199:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375e000, rc 0) 00000100:00100000:3.0:1788666874.063255:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+12:18091:x1875552505067776:12345-192.168.206.34@tcp:101:ll_cfg_requeue.0 Request processed in 158us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.063262:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 147 00000100:00100000:0.0:1788666874.067116:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.068396:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505067904 00000100:00100000:1.0:1788666874.068412:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505067904 00000100:00100000:1.0:1788666874.068482:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 148 00000100:00100000:1.0:1788666874.068493:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+12:18091:x1875552505067904:12345-192.168.206.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.068663:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42372aab-04b6-4821-a139-fec1a872a41d+12:18091:x1875552505067904:12345-192.168.206.34@tcp:501:ll_cfg_requeue.0 Request processed in 172us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.068671:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 148 00000100:00100000:0.0:1788666874.077310:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.077411:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505068032 00000100:00100000:1.0:1788666874.077421:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505068032 00000100:00100000:1.0:1788666874.077516:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 149 00000100:00100000:1.0:1788666874.077526:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707adb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+12:18091:x1875552505068032:12345-192.168.206.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.077665:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707adb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+12:18091:x1875552505068032:12345-192.168.206.34@tcp:503:ll_cfg_requeue.0 Request processed in 140us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.077679:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 149 00000100:00100000:0.0:1788666874.083697:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.083948:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505068160 00000100:00100000:3.0:1788666874.083958:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505068160 00000100:00100000:3.0:1788666874.084019:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 150 00000100:00100000:3.0:1788666874.084029:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+12:18091:x1875552505068160:12345-192.168.206.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666874.084170:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666874.084188:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff936f4375e600/0x4267b949b564b239 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f7e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.084218:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff936f4375e600/0x4267b949b564b239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f7e expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.084229:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff936f4375e600/0x4267b949b564b239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f7e expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.084238:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375e600, rc 0) 00000100:00100000:3.0:1788666874.084337:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+13:18091:x1875552505068160:12345-192.168.206.34@tcp:101:ll_cfg_requeue.0 Request processed in 309us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.084345:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 150 00000100:00100000:0.0:1788666874.089864:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.089956:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505068288 00000100:00100000:1.0:1788666874.089967:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505068288 00000100:00100000:1.0:1788666874.090029:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 151 00000100:00100000:1.0:1788666874.090038:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+13:18091:x1875552505068288:12345-192.168.206.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.090174:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+13:18091:x1875552505068288:12345-192.168.206.34@tcp:501:ll_cfg_requeue.0 Request processed in 137us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.090182:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 151 00000100:00100000:0.0:1788666874.095810:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.095916:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505068416 00000100:00100000:3.0:1788666874.095937:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505068416 00000100:00100000:3.0:1788666874.096003:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 152 00000100:00100000:3.0:1788666874.096014:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+13:18091:x1875552505068416:12345-192.168.206.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.096142:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42372aab-04b6-4821-a139-fec1a872a41d+13:18091:x1875552505068416:12345-192.168.206.34@tcp:503:ll_cfg_requeue.0 Request processed in 129us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.096159:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 152 00000100:00100000:0.0:1788666874.104286:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.104373:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505068672 00000100:00100000:3.0:1788666874.104383:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505068672 00000100:00100000:3.0:1788666874.104456:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 40 00000100:00100000:3.0:1788666874.104466:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+19:18742:x1875552505068672:12345-192.168.206.34@tcp:101:lfs.0 00010000:00010000:3.0:1788666874.104491:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666874.104510:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b240 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f85 expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.104605:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fe00/0x4267b949b564b247 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.104619:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fe00/0x4267b949b564b247 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.104634:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fe00/0x4267b949b564b247 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666874.104644:0:25094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788666874.104753:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b240 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f85 expref: 22 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.104772:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fe00/0x4267b949b564b247 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f85 expref: 21 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.104799:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666874.104802:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666874.104806:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375fe00, rc 0) 00000100:00100000:3.0:1788666874.105311:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+21:18742:x1875552505068672:12345-192.168.206.34@tcp:101:lfs.0 Request processed in 844us (1031us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788666874.105320:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 40 00000100:00100000:0.0:1788666874.109917:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.110017:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505068800 00000100:00100000:1.0:1788666874.110027:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505068800 00000100:00100000:1.0:1788666874.110286:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 41 00000100:00100000:1.0:1788666874.110297:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+21:18742:x1875552505068800:12345-192.168.206.34@tcp:54:lfs.0 00010000:00010000:1.0:1788666874.110358:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110378:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110388:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110434:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110442:0:22759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110448:0:22759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110466:0:22759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031000 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666874.110471:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110478:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110490:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:1.0:1788666874.110493:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666874.110497:0:22759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.110504:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031000/0x4267b949b564b255 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666874.110583:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+21:18742:x1875552505068800:12345-192.168.206.34@tcp:54:lfs.0 Request processed in 286us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.110591:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 41 00000100:00100000:1.0:1788666874.112694:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666874.112807:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505068928 00000100:00100000:2.0:1788666874.112816:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505068928 00000100:00100000:2.0:1788666874.112940:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 0 00000100:00100000:2.0:1788666874.112962:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+21:2394:x1875552505068928:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666874.112977:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666874.113000:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fe00/0x4267b949b564b247 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f85 expref: 21 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.113017:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:2.0:1788666874.113022:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666874.113288:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+20:2394:x1875552505068928:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 327us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.113295:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 0 00000100:00100000:0.0:1788666874.117347:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.117594:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505069184 00000100:00100000:3.0:1788666874.117604:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505069184 00000100:00100000:2.0:1788666874.117782:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 7 00000100:00100000:2.0:1788666874.117795:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+20:18742:x1875552505069184:12345-192.168.206.34@tcp:35:lfs.0 00000100:00100000:2.0:1788666874.118070:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+21:18742:x1875552505069184:12345-192.168.206.34@tcp:35:lfs.0 Request processed in 278us (732us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788666874.118078:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 7 10000000:01000000:1.0:1788666874.139952:0:22756:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788666874.139960:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93706ed88000 from 13 10000000:01000000:1.0:1788666874.139965:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666874.140012:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031000/0x4267b949b564b25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.140024:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937040031000/0x4267b949b564b25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.140036:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937040031000/0x4267b949b564b25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666874.140081:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075592680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525096576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.140154:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666874.140220:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042ad6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788666874.140269:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525096576 00000100:00100000:3.0:1788666874.140279:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525096576 00000100:00100000:3.0:1788666874.140336:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788666874.140347:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+20:22756:x1875552525096576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666874.140364:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666874.140399:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370474c9e00/0x4267b949b564b263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564b25c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.140427:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370474c9e00/0x4267b949b564b263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564b25c expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.140438:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370474c9e00/0x4267b949b564b263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564b25c expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.140448:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c9e00, rc 0) 00000100:00100000:2.0:1788666874.140504:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525096576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.140522:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788666874.142015:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075592680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525096576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666874.142039:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937040031000/0x4267b949b564b25c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b263 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666874.142051:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937040031000/0x4267b949b564b25c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564b263 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666874.142141:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525096704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666874.142211:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666874.142273:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042da8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788666874.142504:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525096704 00000100:00100000:1.0:1788666874.142511:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525096704 00000100:00100000:1.0:1788666874.142741:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788666874.142752:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525096704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.143209:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525096704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 459us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.143218:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788666874.143251:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525096704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666874.143293:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525096832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666874.143340:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666874.143378:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042da8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788666874.143498:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525096832 00000100:00100000:1.0:1788666874.143504:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525096832 00000100:00100000:1.0:1788666874.143546:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788666874.143553:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525096832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.143689:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525096832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.143696:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788666874.143935:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43797800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525096832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788666874.145924:0:25801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788666874.146201:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788666874.146222:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788666874.146232:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040031000/0x4267b949b564b25c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b263 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.146244:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937040031000/0x4267b949b564b25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b263 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666874.146255:0:22756:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788666874.146270:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff93707b51b800 from 13 10000000:01000000:1.0:1788666874.146273:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666874.146307:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030e00/0x4267b949b564b26a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.146316:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff937040030e00/0x4267b949b564b26a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.146326:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff937040030e00/0x4267b949b564b26a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666874.146348:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075592680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525096960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.146406:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666874.146457:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704a1fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666874.146618:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525096960 00000100:00100000:2.0:1788666874.146625:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525096960 00000100:00100000:2.0:1788666874.146682:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788666874.146691:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+21:22756:x1875552525096960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666874.146712:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666874.146725:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9370474c9000/0x4267b949b564b271 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564b26a expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.146749:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9370474c9000/0x4267b949b564b271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564b26a expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.146760:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9370474c9000/0x4267b949b564b271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564b26a expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.146769:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c9000, rc 0) 00000100:00100000:2.0:1788666874.146805:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+22:22756:x1875552525096960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.146811:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788666874.146968:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075592680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525096960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666874.146982:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff937040030e00/0x4267b949b564b26a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b271 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.146991:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff937040030e00/0x4267b949b564b26a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564b271 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666874.147050:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075592680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.147077:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666874.147108:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff93704a1fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666874.147724:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525097088 00000100:00100000:2.0:1788666874.147732:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525097088 00000100:00100000:2.0:1788666874.147772:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788666874.147780:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+22:22756:x1875552525097088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666874.147926:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+22:22756:x1875552525097088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.147933:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788666874.148257:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075592680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.148305:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.148352:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666874.148396:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666874.148627:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525097216 00000100:00100000:1.0:1788666874.148633:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525097216 00000100:00100000:1.0:1788666874.148678:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788666874.148685:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:22756:x1875552525097216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.148788:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+22:22756:x1875552525097216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.148800:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788666874.148894:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788666874.160962:0:25802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788666874.161179:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788666874.161219:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788666874.161235:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff937040030e00/0x4267b949b564b26a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b271 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.161247:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff937040030e00/0x4267b949b564b26a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b271 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666874.161257:0:22756:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788666874.161260:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9370523c9800 from 13 10000000:01000000:2.0:1788666874.161263:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788666874.161300:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370474c8000/0x4267b949b564b278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.161308:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370474c8000/0x4267b949b564b278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.161319:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370474c8000/0x4267b949b564b278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666874.161346:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4441c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666874.161411:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666874.161452:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042b8f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788666874.161804:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525097344 00000100:00100000:1.0:1788666874.161813:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525097344 00000100:00100000:1.0:1788666874.161898:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788666874.161908:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+22:22756:x1875552525097344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666874.161921:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666874.161934:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff937082045600/0x4267b949b564b27f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564b278 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.161956:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff937082045600/0x4267b949b564b27f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564b278 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.161965:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff937082045600/0x4267b949b564b27f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564b278 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.161973:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff937082045600, rc 0) 00000100:00100000:1.0:1788666874.162027:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525097344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.162034:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788666874.162162:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4441c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666874.162178:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370474c8000/0x4267b949b564b278 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b27f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.162187:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370474c8000/0x4267b949b564b278 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564b27f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666874.162259:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.162284:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666874.162314:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666874.162467:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525097472 00000100:00100000:2.0:1788666874.162472:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525097472 00000100:00100000:2.0:1788666874.162492:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788666874.162498:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525097472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666874.162607:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525097472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.162613:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788666874.162757:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.162789:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.162826:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666874.162869:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666874.162921:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525097600 00000100:00100000:1.0:1788666874.162926:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525097600 00000100:00100000:1.0:1788666874.162945:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788666874.162951:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525097600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.163034:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525097600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.163041:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788666874.163256:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788666874.164477:0:25803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788666874.164815:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788666874.164862:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788666874.164873:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370474c8000/0x4267b949b564b278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b27f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.164886:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370474c8000/0x4267b949b564b278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b27f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666874.164896:0:22756:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788666874.164899:0:22756:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff937065bbb800 from 13 10000000:01000000:2.0:1788666874.164901:0:22756:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788666874.164935:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370474c9a00/0x4267b949b564b286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.164942:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.134@tcp lock: ffff9370474c9a00/0x4267b949b564b286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.164951:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.134@tcp lock: ffff9370474c9a00/0x4267b949b564b286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666874.164972:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4441ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666874.165028:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666874.165078:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042b8fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666874.165294:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525097728 00000100:00100000:1.0:1788666874.165311:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525097728 00000100:00100000:1.0:1788666874.165359:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788666874.165368:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+23:22756:x1875552525097728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666874.165382:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666874.165395:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93704dd0d800/0x4267b949b564b28d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4267b949b564b286 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.165417:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93704dd0d800/0x4267b949b564b28d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4267b949b564b286 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.165427:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93704dd0d800/0x4267b949b564b28d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4267b949b564b286 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.165435:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93704dd0d800, rc 0) 00000100:00100000:1.0:1788666874.165478:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:22756:x1875552525097728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.165484:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788666874.165639:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4441ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666874.165654:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.134@tcp lock: ffff9370474c9a00/0x4267b949b564b286 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b28d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.165663:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.134@tcp lock: ffff9370474c9a00/0x4267b949b564b286 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4267b949b564b28d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666874.165726:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.165752:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666874.165828:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666874.172128:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525097856 00000100:00100000:0.0:1788666874.172142:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525097856 00000100:00100000:1.0:1788666874.175310:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788666874.175324:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:22756:x1875552525097856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666874.175492:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a62c9863-c7b0-471d-812b-42670ca06572+24:22756:x1875552525097856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (9738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.175499:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788666874.175580:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.175626:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666874.175677:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666874.177186:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666874.177347:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525097984 00000100:00100000:2.0:1788666874.177355:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525097984 00000100:00100000:2.0:1788666874.177393:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788666874.177468:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707b705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:22756:x1875552525097984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666874.177599:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707b705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a62c9863-c7b0-471d-812b-42670ca06572+24:22756:x1875552525097984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.177606:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788666874.177748:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4206a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a62c9863-c7b0-471d-812b-42670ca06572:22756:1875552525097984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788666874.178920:0:25804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788666874.179401:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788666874.179426:0:22756:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.206.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788666874.179436:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.134@tcp lock: ffff9370474c9a00/0x4267b949b564b286 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b28d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.179447:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.134@tcp lock: ffff9370474c9a00/0x4267b949b564b286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4267b949b564b28d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666874.268298:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666874.268320:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525098112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788666874.268384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666874.268471:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525098112 00000100:00100000:1.0:1788666874.268478:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525098112 00000100:00100000:1.0:1788666874.268527:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788666874.268536:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525098112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788666874.268584:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788666874.268639:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525098112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666874.268658:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788666874.268762:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525098112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788666874.408863:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666874.409553:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505069440 00000100:00100000:2.0:1788666874.409564:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505069440 00000100:00100000:2.0:1788666874.409626:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 42 00000100:00100000:2.0:1788666874.409637:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+21:18774:x1875552505069440:12345-192.168.206.34@tcp:101:cat.0 00010000:00010000:2.0:1788666874.409661:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666874.409682:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b294 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f8c expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.409800:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9600/0x4267b949b564b29b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.409815:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9600/0x4267b949b564b29b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.409827:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9600/0x4267b949b564b29b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666874.409863:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788666874.409983:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b294 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f8c expref: 24 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.410012:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9600/0x4267b949b564b29b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f8c expref: 23 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.410021:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:2.0:1788666874.410024:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666874.410027:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c9600, rc 0) 00000100:00100000:2.0:1788666874.410240:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+23:18774:x1875552505069440:12345-192.168.206.34@tcp:101:cat.0 Request processed in 605us (1408us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788666874.410248:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 42 00000100:00100000:0.0:1788666874.417398:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666874.417447:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.417551:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505069824 00000100:00100000:1.0:1788666874.417571:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505069824 00000100:00100000:1.0:1788666874.417637:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:1.0:1788666874.417648:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+23:18774:x1875552505069824:12345-192.168.206.34@tcp:35:cat.0 00000100:00100000:1.0:1788666874.417998:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+24:18774:x1875552505069824:12345-192.168.206.34@tcp:35:cat.0 Request processed in 350us (549us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788666874.418012:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 8 00000100:00100000:3.0:1788666874.418494:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505069568 00000100:00100000:3.0:1788666874.418502:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505069568 00000100:00100000:3.0:1788666874.418593:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 1 00000100:00100000:3.0:1788666874.418603:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+24:2396:x1875552505069568:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666874.418617:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666874.418643:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9600/0x4267b949b564b29b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f8c expref: 24 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.418661:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666874.418667:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666874.418715:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+23:2396:x1875552505069568:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 114us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.418723:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 1 00000100:00100000:0.0:1788666874.482085:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.482196:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505070080 00000100:00100000:1.0:1788666874.482326:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505070080 00000100:00100000:1.0:1788666874.482394:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 43 00000100:00100000:1.0:1788666874.482419:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+23:18780:x1875552505070080:12345-192.168.206.34@tcp:101:dd.0 00010000:00010000:1.0:1788666874.482447:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666874.482469:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0ce00/0x4267b949b564b2a9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f93 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.482576:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.482590:0:22759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.482598:0:22759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 24 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.482606:0:22759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.482651:0:22759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 24 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.482665:0:22759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 24 pid: 25094 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666874.482678:0:22759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075591f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22759:1875552525098240:192.168.206.34@tcp:104: 00010000:00010000:1.0:1788666874.482784:0:22759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666874.482794:0:22759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 24 pid: 22758 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666874.482804:0:22759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937075590e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22759:1875552525098368:192.168.206.34@tcp:104: 00000100:00100000:1.0:1788666874.482831:0:22759:0:(client.c:2716:ptlrpc_set_wait()) set ffff937072258300 going to sleep for 11 seconds 00000100:00100000:1.0:1788666874.486458:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666874.486564:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.486636:0:22759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075591f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22759:1875552525098240:192.168.206.34@tcp:104: 00000100:00100000:3.0:1788666874.486649:0:22759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937075590e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22759:1875552525098368:192.168.206.34@tcp:104: 00010000:00010000:3.0:1788666874.486675:0:22759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666874.487414:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505070208 00000100:00100000:2.0:1788666874.487422:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505070208 00010000:00010000:2.0:1788666874.487462:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 25 pid: 25094 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666874.487497:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505070336 00000100:00100000:2.0:1788666874.487500:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505070336 00010000:00010000:2.0:1788666874.487513:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 26 pid: 22758 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666874.487529:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 17 00000100:00100000:2.0:1788666874.487538:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+26:2395:x1875552505070208:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666874.487552:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666874.487558:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 26 pid: 25094 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.487569:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 26 pid: 25094 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.487605:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f200/0x4267b949b564b21d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f69 expref: 26 pid: 25094 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.487622:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:2.0:1788666874.487627:0:22743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.487636:0:22743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.487642:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666874.487731:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+25:2395:x1875552505070208:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 193us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.487742:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 17 00000100:00100000:2.0:1788666874.488079:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 18 00000100:00100000:2.0:1788666874.488089:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4301c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+24:2395:x1875552505070336:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666874.488097:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666874.488103:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 24 pid: 22758 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.488113:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 24 pid: 22758 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.488126:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031800/0x4267b949b564b208 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f62 expref: 24 pid: 22758 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.488163:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:2.0:1788666874.488167:0:22743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.488176:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.488183:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.488205:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666874.488227:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4301c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+23:2395:x1875552505070336:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 140us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.488235:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 18 00010000:00010000:3.0:1788666874.489032:0:22759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.489044:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666874.489070:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788666874.489231:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0ce00/0x4267b949b564b2a9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f93 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.489247:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0de00/0x4267b949b564b2b0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f93 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.489255:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666874.489258:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788666874.489261:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93704dd0de00, rc 0) 00000100:00100000:3.0:1788666874.489324:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+23:18780:x1875552505070080:12345-192.168.206.34@tcp:101:dd.0 Request processed in 6922us (7247us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788666874.489333:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 43 00000100:00100000:1.0:1788666874.492084:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.492143:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505070464 00000100:00100000:3.0:1788666874.492166:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505070464 00000100:00100000:3.0:1788666874.492231:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 44 00000100:00100000:3.0:1788666874.492243:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+23:18780:x1875552505070464:12345-192.168.206.34@tcp:101:dd.0 00010000:00010000:3.0:1788666874.492273:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666874.492299:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2be lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52f9a expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.492341:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.492356:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.492386:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.492497:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2be lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 25 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.492514:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 24 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.492523:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666874.492526:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788666874.492529:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375fc00, rc 0) 00000100:00100000:3.0:1788666874.492589:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+24:18780:x1875552505070464:12345-192.168.206.34@tcp:101:dd.0 Request processed in 349us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.492597:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 44 00000100:00100000:1.0:1788666874.499043:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666874.499132:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505070720 00000100:00100000:2.0:1788666874.499145:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505070720 00000100:00100000:2.0:1788666874.499210:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 45 00000100:00100000:2.0:1788666874.499223:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+24:18780:x1875552505070720:12345-192.168.206.34@tcp:36:dd.0 00010000:00010000:2.0:1788666874.499444:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.499463:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.499475:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666874.499526:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788666874.499549:0:22758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a85b161a reply state 0000000077fa8df2 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.499586:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.499594:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:2.0:1788666874.499597:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788666874.499601:0:22758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666874.499694:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+27:18780:x1875552505070720:12345-192.168.206.34@tcp:36:dd.0 Request processed in 473us (659us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788666874.499716:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 45 00000020:00080000:2.0:1788666874.499722:0:22758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788666874.502438:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.502567:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505070848 00000100:00100000:3.0:1788666874.502577:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505070848 00000100:00100000:3.0:1788666874.502636:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 46 00000100:00100000:3.0:1788666874.502646:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+27:18780:x1875552505070848:12345-192.168.206.34@tcp:101:dd.0 00010000:00010000:3.0:1788666874.502670:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666874.502690:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b2d3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fa1 expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.502761:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b2d3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa1 expref: 28 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.502778:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b2d3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa1 expref: 28 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.502818:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666874.502822:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666874.502826:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375e800, rc 0) 00000100:00100000:3.0:1788666874.502906:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+28:18780:x1875552505070848:12345-192.168.206.34@tcp:101:dd.0 Request processed in 260us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.502912:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 46 00000100:00100000:1.0:1788666874.514401:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666874.514504:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505071104 00000100:00100000:2.0:1788666874.514524:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505071104 00000100:00100000:2.0:1788666874.514593:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 2 00000100:00100000:2.0:1788666874.514603:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+28:18780:x1875552505071104:12345-192.168.206.34@tcp:103:dd.0 00010000:00010000:2.0:1788666874.514619:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666874.514642:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b2d3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa1 expref: 28 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.514660:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:2.0:1788666874.514665:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666874.514729:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+27:18780:x1875552505071104:12345-192.168.206.34@tcp:103:dd.0 Request processed in 127us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.514736:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 2 00000100:00100000:1.0:1788666874.517467:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.517683:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505071232 00000100:00100000:3.0:1788666874.517694:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505071232 00000100:00100000:3.0:1788666874.517784:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 47 00000100:00100000:3.0:1788666874.517795:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937075591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+27:18780:x1875552505071232:12345-192.168.206.34@tcp:58:dd.0 00010000:00010000:3.0:1788666874.517951:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.517968:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.517980:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788666874.519295:0:22759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666874.519330:0:22759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788666874.519471:0:22759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788666874.519576:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937075591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+27:18780:x1875552505071232:12345-192.168.206.34@tcp:58:dd.0 Request processed in 1777us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.519587:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 47 00010000:00010000:0.0:1788666874.525265:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666874.526934:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.527032:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505071360 00000100:00100000:3.0:1788666874.527043:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505071360 00000100:00100000:3.0:1788666874.527110:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 48 00000100:00100000:3.0:1788666874.527120:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+27:18780:x1875552505071360:12345-192.168.206.34@tcp:101:dd.0 00010000:00010000:3.0:1788666874.527141:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666874.527162:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fa8 expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.527221:0:25094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.527232:0:25094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa8 expref: 28 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.527250:0:25094:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.527262:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa8 expref: 28 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.527275:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666874.527278:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666874.527281:0:25094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa8 expref: 28 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.527288:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375f000, rc 0) 00000100:00100000:3.0:1788666874.527356:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+28:18780:x1875552505071360:12345-192.168.206.34@tcp:101:dd.0 Request processed in 238us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.527363:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 48 00000040:00080000:1.0:1788666874.909291:0:22794:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788666874.909301:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788666874.909338:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788666874.909352:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788666874.909482:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707dd5b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22794:1875552525098496:192.168.206.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788666874.909776:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370722580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666874.923029:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666874.923154:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707dd5b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22794:1875552525098496:192.168.206.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788666874.923922:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505071488 00000100:00100000:3.0:1788666874.923942:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505071488 00000100:00100000:3.0:1788666874.924004:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 49 00000100:00100000:3.0:1788666874.924014:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+28:18781:x1875552505071488:12345-192.168.206.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788666874.924046:0:22758:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788666874.924164:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+28:18781:x1875552505071488:12345-192.168.206.34@tcp:53:lhsmtool_posix.0 Request processed in 150us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.924171:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 49 00000100:00100000:0.0:1788666874.929278:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.929412:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505071616 00000100:00100000:3.0:1788666874.929423:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505071616 00000100:00100000:3.0:1788666874.929488:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 50 00000100:00100000:3.0:1788666874.929498:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+28:18781:x1875552505071616:12345-192.168.206.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788666874.929580:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.929598:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.929612:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.929941:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.929952:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.929960:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.929985:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930007:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930014:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666874.930058:0:25094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788666874.930062:0:25094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788666874.930079:0:25094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930089:0:25094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930095:0:25094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930101:0:25094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930107:0:25094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375fa00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1788666874.930111:0:25094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930118:0:25094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930129:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff936f42326900) 00010000:00010000:3.0:1788666874.930132:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666874.930137:0:25094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930153:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fa00/0x4267b949b564b2e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930166:0:25094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930177:0:25094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930183:0:25094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930188:0:25094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375f400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1788666874.930191:0:25094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930197:0:25094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930205:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff937042dd4700) 00010000:00010000:3.0:1788666874.930207:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666874.930210:0:25094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930215:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f400/0x4267b949b564b2ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930230:0:25094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930236:0:25094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930246:0:25094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930251:0:25094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375ee00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1788666874.930254:0:25094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930261:0:25094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930269:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666874.930272:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666874.930274:0:25094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.930279:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b2f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666874.930361:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+28:18781:x1875552505071616:12345-192.168.206.34@tcp:34:lhsmtool_posix.0 Request processed in 863us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666874.930370:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 50 00000100:00100000:1.0:1788666874.934175:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.934242:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505071872 00000100:00100000:3.0:1788666874.934253:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505071872 00000100:00100000:3.0:1788666874.934308:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 51 00000100:00100000:3.0:1788666874.934318:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+28:18781:x1875552505071872:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666874.934338:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666874.934359:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ec00/0x4267b949b564b2fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52faf expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934492:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934506:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934516:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666874.934527:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788666874.934616:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934622:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934627:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934641:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1788666874.934645:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934652:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934663:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:3.0:1788666874.934666:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788666874.934670:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934685:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b304 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934735:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ec00/0x4267b949b564b2fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52faf expref: 30 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934745:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff936f42326900) 00010000:00010000:3.0:1788666874.934747:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788666874.934751:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ec00/0x4267b949b564b2fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52faf expref: 30 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.934759:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375ec00, rc 0) 00000100:00100000:3.0:1788666874.934819:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+29:18781:x1875552505071872:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 502us (652us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1788666874.934827:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 51 00000100:00100000:1.0:1788666874.939287:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666874.940768:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505072000 00000100:00100000:2.0:1788666874.940784:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505072000 00000100:00100000:2.0:1788666874.940878:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 52 00000100:00100000:2.0:1788666874.940889:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+29:18781:x1875552505072000:12345-192.168.206.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788666874.942058:0:22760:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788666874.942557:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+29:18781:x1875552505072000:12345-192.168.206.34@tcp:53:lhsmtool_posix.0 Request processed in 1665us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.942568:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 52 00000100:00100000:1.0:1788666874.950392:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.950478:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505072256 00000100:00100000:3.0:1788666874.950488:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505072256 00000100:00100000:3.0:1788666874.950552:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 53 00000100:00100000:3.0:1788666874.950639:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+29:18781:x1875552505072256:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666874.950660:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666874.950680:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ec00/0x4267b949b564b312 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fb6 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788666874.951282:0:22758:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1788666874.951290:0:22758:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1788666874.951310:0:22758:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788666874.951653:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8c00/0x4267b949b564b319 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.951668:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8c00/0x4267b949b564b319 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.951680:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8c00/0x4267b949b564b319 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.951756:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ec00/0x4267b949b564b312 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fb6 expref: 32 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.951776:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8c00/0x4267b949b564b319 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fb6 expref: 31 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.951785:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f42326400) 00010000:00010000:2.0:1788666874.951788:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666874.951791:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c8c00, rc 0) 00000100:00100000:2.0:1788666874.952073:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+31:18781:x1875552505072256:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 1339us (1517us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788666874.952098:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 53 00000100:00100000:1.0:1788666874.957705:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666874.958058:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505072512 00000100:00100000:3.0:1788666874.958069:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505072512 00000100:00100000:3.0:1788666874.958130:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 54 00000100:00100000:3.0:1788666874.958149:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+31:18781:x1875552505072512:12345-192.168.206.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788666874.958233:0:25094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666874.958269:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8c00/0x4267b949b564b319 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fb6 expref: 31 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.958288:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f42326400) 00010000:00010000:3.0:1788666874.958297:0:25094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666874.958320:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959608:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959628:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959653:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959661:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959668:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959727:0:25094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959735:0:25094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959741:0:25094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959758:0:25094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1788666874.959763:0:25094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959770:0:25094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959781:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:3.0:1788666874.959784:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666874.959788:0:25094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959793:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b327 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959805:0:25094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959810:0:25094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959815:0:25094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959819:0:25094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375ee00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:3.0:1788666874.959822:0:25094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959827:0:25094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959983:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x94864611 (ffff937042dd4700) 00010000:00010000:3.0:1788666874.959985:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666874.959988:0:25094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666874.959995:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375ee00/0x4267b949b564b32e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x94864611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666874.965244:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+30:18781:x1875552505072512:12345-192.168.206.34@tcp:36:lhsmtool_posix.0 Request processed in 7091us (7543us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666874.968212:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 54 00000100:00100000:1.0:1788666874.972532:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666874.972632:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505072640 00000100:00100000:0.0:1788666874.972642:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505072640 00000100:00100000:0.0:1788666874.972762:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 55 00000100:00100000:0.0:1788666874.972773:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+30:18781:x1875552505072640:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788666874.972794:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666874.972819:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0800/0x4267b949b564b335 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fbd expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666874.972881:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e1200/0x4267b949b564b33c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666874.972895:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e1200/0x4267b949b564b33c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666874.972932:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e1200/0x4267b949b564b33c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666874.973039:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0800/0x4267b949b564b335 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fbd expref: 32 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666874.973058:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e1200/0x4267b949b564b33c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fbd expref: 31 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666874.973065:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:0.0:1788666874.973069:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788666874.973072:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93705d3e1200, rc 0) 00000100:00100000:0.0:1788666874.973132:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+31:18781:x1875552505072640:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 361us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666874.973148:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 55 00000100:00100000:1.0:1788666874.979586:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666874.979686:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505072896 00000100:00100000:2.0:1788666874.979706:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505072896 00000100:00100000:2.0:1788666874.979815:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 56 00000100:00100000:2.0:1788666874.979826:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+31:18781:x1875552505072896:12345-192.168.206.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788666874.979953:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.979973:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.979985:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666874.980157:0:22760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1788666874.980167:0:22760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698023332925ns, next at 699023330729ns, rc = 0 00000004:00010000:2.0:1788666874.980221:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000983d8537 reply state 00000000032eba52 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.980236:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.980242:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:2.0:1788666874.980245:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788666874.980262:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666874.980383:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+33:18781:x1875552505072896:12345-192.168.206.34@tcp:36:lhsmtool_posix.0 Request processed in 558us (805us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788666874.980390:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 56 00000100:00100000:1.0:1788666874.992900:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666874.993044:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505073024 00000100:00100000:2.0:1788666874.993054:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505073024 00000100:00100000:2.0:1788666874.993117:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 57 00000100:00100000:2.0:1788666874.993128:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+33:18781:x1875552505073024:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666874.993165:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666874.993191:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fc4 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.993262:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 34 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.993277:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 34 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666874.993297:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:2.0:1788666874.993301:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788666874.993305:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c8a00, rc 0) 00000100:00100000:2.0:1788666874.993379:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+34:18781:x1875552505073024:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 252us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666874.993386:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 57 00000100:00100000:1.0:1788666875.006711:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.006923:0:25552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505073152 00000100:00100000:2.0:1788666875.006933:0:25552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505073152 00000100:00100000:2.0:1788666875.007006:0:25552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 20 00000100:00100000:2.0:1788666875.007018:0:25552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2396:x1875552505073152:12345-192.168.206.34@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788666875.007998:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666875.008127:0:25552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2396:x1875552505073152:12345-192.168.206.34@tcp:2:lhsmtool_posix.0 Request processed in 1108us (1431us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788666875.008137:0:25552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 20 00000100:00100000:1.0:1788666875.015732:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.015915:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505073408 00000100:00100000:2.0:1788666875.015924:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505073408 00000100:00100000:2.0:1788666875.015992:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 9 00000100:00100000:2.0:1788666875.016003:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+34:18781:x1875552505073408:12345-192.168.206.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788666875.016220:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+35:18781:x1875552505073408:12345-192.168.206.34@tcp:35:lhsmtool_posix.0 Request processed in 219us (497us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788666875.016228:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 9 00000100:00080000:3.0:1788666875.016342:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666875.029775:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666875.029876:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505073664 00000100:00100000:0.0:1788666875.029885:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505073664 00000100:00100000:0.0:1788666875.029945:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 58 00000100:00100000:0.0:1788666875.029955:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+35:18781:x1875552505073664:12345-192.168.206.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788666875.030059:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+35:18781:x1875552505073664:12345-192.168.206.34@tcp:57:lhsmtool_posix.0 Request processed in 105us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666875.030067:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 58 00000100:00100000:1.0:1788666875.032962:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.033069:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505073792 00000100:00100000:2.0:1788666875.033078:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505073792 00000100:00100000:2.0:1788666875.033135:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 59 00000100:00100000:2.0:1788666875.033152:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+35:18781:x1875552505073792:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666875.033169:0:22760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666875.033190:0:22760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9c00/0x4267b949b564b351 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fcb expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.033257:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b358 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.033272:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.033282:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666875.033471:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788666875.033493:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.033597:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9c00/0x4267b949b564b351 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fcb expref: 37 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.033617:0:22760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b358 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fcb expref: 36 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.033625:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:2.0:1788666875.033628:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788666875.033632:0:22760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c8200, rc 0) 00000100:00100000:2.0:1788666875.033702:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+36:18781:x1875552505073792:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 550us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666875.033711:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 59 00000100:00100000:1.0:1788666875.038376:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666875.039168:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505073920 00000100:00100000:3.0:1788666875.039178:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505073920 00000100:00100000:3.0:1788666875.039229:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 21 00000100:00100000:3.0:1788666875.039238:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2397:x1875552505073920:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666875.039256:0:24261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666875.039276:0:24261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fd2 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666875.039301:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ce3fb, blocks: 0x0 00010000:00010000:3.0:1788666875.039321:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=698s v=(0 0) 00010000:00010000:3.0:1788666875.039337:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666875.039346:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 7 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.039365:0:24261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 7 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.039395:0:24261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff936f4375ee00, rc 0) 00000100:00100000:3.0:1788666875.039461:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:2397:x1875552505073920:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 224us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666875.039468:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 21 00000100:00100000:1.0:1788666875.043055:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666875.043161:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505074176 00000100:00100000:0.0:1788666875.043172:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505074176 00000100:00100000:0.0:1788666875.043226:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 60 00000100:00100000:0.0:1788666875.043237:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+36:18781:x1875552505074176:12345-192.168.206.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788666875.043374:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+36:18781:x1875552505074176:12345-192.168.206.34@tcp:57:lhsmtool_posix.0 Request processed in 138us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666875.043381:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 60 00000100:00100000:2.0:1788666875.047557:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666875.047637:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505074304 00000100:00100000:0.0:1788666875.047646:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505074304 00000100:00100000:0.0:1788666875.047712:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 61 00000100:00100000:0.0:1788666875.047722:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+36:18781:x1875552505074304:12345-192.168.206.34@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788666875.052794:0:22738:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788666875.052809:0:22738:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788666875.052966:0:22738:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1788666875.053226:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.053240:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.053258:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.053264:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031a00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:2.0:1788666875.053268:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.053289:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.053307:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:2.0:1788666875.053310:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788666875.053316:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.053334:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031a00/0x4267b949b564b1a6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053542:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053552:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053559:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053565:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1788666875.053568:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053575:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053584:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9370439b9700) 00010000:00010000:0.0:1788666875.053587:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666875.053591:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053597:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031400/0x4267b949b564b152 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053621:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053628:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053635:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053640:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040030c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1788666875.053644:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053650:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053658:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9370439b9600) 00010000:00010000:0.0:1788666875.053661:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666875.053664:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053670:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040030c00/0x4267b949b564b159 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053681:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053687:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053705:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053717:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff937040031200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1788666875.053720:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053727:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053735:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9370439b9d00) 00010000:00010000:0.0:1788666875.053738:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666875.053740:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053746:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff937040031200/0x4267b949b564b201 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053761:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053767:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053773:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053778:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1788666875.053781:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053787:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053807:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:0.0:1788666875.053809:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666875.053812:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053818:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8400/0x4267b949b564b2cc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053829:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053888:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053896:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053902:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c9200 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:0.0:1788666875.053905:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053912:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053921:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:0.0:1788666875.053923:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788666875.053926:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.053933:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9200/0x4267b949b564b343 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666875.054084:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+15:18781:x1875552505074304:12345-192.168.206.34@tcp:44:lhsmtool_posix.0 Request processed in 6358us (6530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666875.054094:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 61 00000100:00100000:2.0:1788666875.054425:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707dd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525098624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788666875.054479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666875.054641:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525098624 00000100:00100000:1.0:1788666875.054649:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525098624 00000100:00080000:3.0:1788666875.054704:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788666875.054724:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788666875.054735:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525098624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788666875.054876:0:24938:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788666875.054880:0:24938:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788666875.054882:0:24938:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788666875.054884:0:24938:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788666875 -> 1788666875 00002000:00010000:1.0:1788666875.054887:0:24938:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788666875.055226:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875552525098624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 491us (744us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788666875.055249:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1788666875.055346:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93707dd58700/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788666875.055353:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707dd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525098624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788666875.059340:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.059420:0:25552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505074432 00000100:00100000:2.0:1788666875.059430:0:25552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505074432 00000100:00100000:2.0:1788666875.059488:0:25552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 23 00000100:00100000:2.0:1788666875.059499:0:25552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:2397:x1875552505074432:12345-192.168.206.34@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788666875.059620:0:25552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:2397:x1875552505074432:12345-192.168.206.34@tcp:16:lhsmtool_posix.0 Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666875.059628:0:25552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 23 00000100:00100000:3.0:1788666875.066960:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666875.067021:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505074688 00000100:00100000:0.0:1788666875.067032:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505074688 00000100:00100000:0.0:1788666875.067097:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 62 00000100:00100000:0.0:1788666875.067107:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+15:18781:x1875552505074688:12345-192.168.206.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788666875.067153:0:25094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666875.067178:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b358 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fcb expref: 15 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.067196:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:0.0:1788666875.067201:0:25094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666875.067228:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0800/0x4267b949b564b366 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.067242:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0800/0x4267b949b564b366 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.067252:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0800/0x4267b949b564b366 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788666875.067390:0:25094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021571789 reply state 00000000d0dce3e6 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0800/0x4267b949b564b366 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.067403:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0800/0x4267b949b564b366 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.067424:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:0.0:1788666875.067427:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788666875.067430:0:25094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788666875.067529:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+16:18781:x1875552505074688:12345-192.168.206.34@tcp:36:lhsmtool_posix.0 Request processed in 421us (576us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788666875.067537:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 62 00000100:00100000:1.0:1788666875.091431:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.091585:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505074816 00000100:00100000:2.0:1788666875.091594:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505074816 00000100:00100000:2.0:1788666875.091654:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 24 00000100:00100000:2.0:1788666875.091664:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:18781:x1875552505074816:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666875.091707:0:24264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666875.091724:0:24264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fd9 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.091754:0:24264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 8 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.091762:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666875.091767:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666875.091772:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 8 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.091804:0:24264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 8 pid: 24261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.091817:0:24264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 8 pid: 24261 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666875.091831:0:24264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4441ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24264:1875552525098752:192.168.206.34@tcp:104: 00000100:00100000:2.0:1788666875.091957:0:24264:0:(client.c:2716:ptlrpc_set_wait()) set ffff93707b904600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666875.103869:0:24264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4441ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24264:1875552525098752:192.168.206.34@tcp:104: 00010000:00010000:2.0:1788666875.103908:0:24264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 8 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.103927:0:24264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c9c00, rc 0) 00000100:00100000:2.0:1788666875.104005:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+8:18781:x1875552505074816:12345-192.168.206.34@tcp:101:lhsmtool_posix.0 Request processed in 12342us (12582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666875.104015:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 24 00000100:00100000:3.0:1788666875.106667:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.106757:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505074944 00000100:00100000:2.0:1788666875.106768:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505074944 00010000:00010000:2.0:1788666875.106809:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 8 pid: 24261 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666875.106879:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 19 00000100:00100000:2.0:1788666875.106889:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4206ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+8:2397:x1875552505074944:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666875.106930:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666875.106955:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 8 pid: 24261 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.106968:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 8 pid: 24261 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.106990:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000540b4c2/0x4267b949b564b35f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd2 expref: 8 pid: 24261 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.107006:0:22744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666875.107011:0:22744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666875.107017:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 7 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.107025:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 7 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.107069:0:22744:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 7 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666875.107081:0:22744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f4441ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22744:1875552525098880:192.168.206.34@tcp:105: 00000100:00100000:2.0:1788666875.107378:0:22744:0:(client.c:2716:ptlrpc_set_wait()) set ffff93707b904600 going to sleep for 11 seconds 00000100:00100000:1.0:1788666875.114309:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.114416:0:22744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f4441ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22744:1875552525098880:192.168.206.34@tcp:105: 00010000:00010000:2.0:1788666875.114439:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666875.114492:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4206ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:2397:x1875552505074944:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 7605us (7835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666875.114504:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 19 00000100:00100000:3.0:1788666875.115231:0:24938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505075072 00000100:00100000:3.0:1788666875.115239:0:24938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505075072 00000100:00100000:3.0:1788666875.115283:0:24938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 25 00000100:00100000:3.0:1788666875.115292:0:24938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:2397:x1875552505075072:12345-192.168.206.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788666875.115535:0:24938:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788666875.115539:0:24938:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788666875 00002000:00010000:3.0:1788666875.115541:0:24938:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788666874 00002000:00010000:3.0:1788666875.115544:0:24938:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788666875 -> 1788666875 00002000:00010000:3.0:1788666875.115546:0:24938:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788666875.115600:0:24938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+8:2397:x1875552505075072:12345-192.168.206.34@tcp:2:lhsmtool_posix.0 Request processed in 309us (1299us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788666875.115607:0:24938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 25 00000100:00100000:1.0:1788666875.118424:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666875.118557:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505075200 00000100:00100000:3.0:1788666875.118565:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505075200 00000100:00100000:3.0:1788666875.118626:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 26 00000100:00100000:3.0:1788666875.118648:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff937047111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+8:2396:x1875552505075200:12345-192.168.206.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788666875.118688:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.118718:0:24261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 8 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.118726:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666875.118730:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666875.118735:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.118770:0:24261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 8 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.118784:0:24261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 8 pid: 24264 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666875.118798:0:24261:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42068380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24261:1875552525099008:192.168.206.34@tcp:104: 00000100:00100000:3.0:1788666875.118900:0:24261:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666875.126082:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666875.126290:0:24261:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42068380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24261:1875552525099008:192.168.206.34@tcp:104: 00010000:00010000:3.0:1788666875.126318:0:24261:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666875.126394:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505075328 00000100:00100000:1.0:1788666875.126401:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505075328 00010000:00010000:1.0:1788666875.126436:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 9 pid: 24264 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666875.126521:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 20 00000100:00100000:1.0:1788666875.126531:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+9:2396:x1875552505075328:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666875.126545:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666875.126564:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 9 pid: 24264 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.126577:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 9 pid: 24264 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.126597:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b30eef3/0x4267b949b564b36d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fd9 expref: 9 pid: 24264 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.126613:0:22745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788666875.126617:0:22745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788666875.126623:0:22745:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.126648:0:22745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.126676:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666875.126741:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+8:2396:x1875552505075328:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 211us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666875.126748:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 20 00010000:00010000:3.0:1788666875.126799:0:24261:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.126815:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.126864:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.126874:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.126882:0:24261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.126889:0:24261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e800 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666875.126894:0:24261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.126903:0:24261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.126915:0:24261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.126923:0:24261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a8acad/0x4267b949b564b374 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666875.126979:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff937047111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+7:2396:x1875552505075200:12345-192.168.206.34@tcp:1:lhsmtool_posix.0 Request processed in 8333us (8563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666875.126987:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 26 00000100:00100000:3.0:1788666875.129201:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666875.129336:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505075584 00000100:00100000:0.0:1788666875.129346:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505075584 00000100:00100000:0.0:1788666875.129408:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 63 00000100:00100000:0.0:1788666875.129417:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+16:18781:x1875552505075584:12345-192.168.206.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788666875.129499:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.129516:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 16 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.129526:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.129559:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 16 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666875.129573:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 16 pid: 25094 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666875.129588:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43797100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22758:1875552525099136:192.168.206.34@tcp:104: 00000100:00100000:0.0:1788666875.129671:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff937042da8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788666875.132182:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.132392:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505075712 00000100:00100000:2.0:1788666875.132402:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505075712 00010000:00010000:2.0:1788666875.132438:0:22744:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 17 pid: 25094 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666875.132472:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 21 00000100:00100000:2.0:1788666875.132481:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+17:2397:x1875552505075712:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666875.132496:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666875.132503:0:22744:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 17 pid: 25094 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.132515:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 17 pid: 25094 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.132552:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:2.0:1788666875.132558:0:22744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa8 expref: 17 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.132567:0:22744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.132574:0:22744:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.132582:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.132599:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666875.132654:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+17:2397:x1875552505075712:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 173us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666875.132662:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 21 00010000:00010000:3.0:1788666875.133018:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375fc00/0x4267b949b564b2c5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52f9a expref: 16 pid: 25094 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666875.133033:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43797100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22758:1875552525099136:192.168.206.34@tcp:104: 00010000:00010000:3.0:1788666875.133053:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.133064:0:22758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.133070:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.133264:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.133276:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 16 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.133283:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.133310:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 16 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.133331:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 16 pid: 22758 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666875.133345:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22758:1875552525099264:192.168.206.34@tcp:104: 00000100:00100000:3.0:1788666875.133399:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788666875.138193:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:3.0:1788666875.138355:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22758:1875552525099264:192.168.206.34@tcp:104: 00010000:00010000:3.0:1788666875.138383:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666875.138427:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505075840 00000100:00100000:1.0:1788666875.138434:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505075840 00010000:00010000:1.0:1788666875.138470:0:22745:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 17 pid: 22758 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666875.138509:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 22 00000100:00100000:1.0:1788666875.138517:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+17:2396:x1875552505075840:12345-192.168.206.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666875.138531:0:22745:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666875.138537:0:22745:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 17 pid: 22758 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.138547:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 17 pid: 22758 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.138566:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b34a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fc4 expref: 17 pid: 22758 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.138579:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:1.0:1788666875.138596:0:22745:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.138606:0:22745:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.138613:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.138674:0:22745:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666875.138786:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+16:2396:x1875552505075840:12345-192.168.206.34@tcp:103:ldlm_bl.0 Request processed in 269us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666875.138793:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 22 00010000:00010000:3.0:1788666875.139105:0:22758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.139113:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788666875.139207:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1788666875.139321:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788666875.139355:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1788666875.139445:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22758:1875552525099392:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788666875.139490:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666875.139523:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666875.139614:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525099392 00000100:00100000:2.0:1788666875.139620:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525099392 00000100:00100000:2.0:1788666875.139661:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788666875.139669:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22758:x1875552525099392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788666875.139757:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22758:x1875552525099392:12345-0@lo:1000:mdt00_000.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666875.139765:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788666875.139898:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22758:1875552525099392:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788666875.140155:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1788666875.140197:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22758:1875552525099520:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788666875.140224:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666875.140250:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff936f4360fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666875.140303:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525099520 00000100:00100000:2.0:1788666875.140308:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525099520 00000100:00100000:2.0:1788666875.140342:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788666875.140349:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22758:x1875552525099520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788666875.140474:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22758:x1875552525099520:12345-0@lo:1000:mdt00_000.0 Request processed in 124us (248us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788666875.140481:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788666875.140618:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42069f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22758:1875552525099520:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788666875.140646:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140655:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140662:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140668:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666875.140672:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140679:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140692:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:1.0:1788666875.140711:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666875.140716:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140723:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e800/0x4267b949b564b382 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140751:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140757:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140763:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140767:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff936f4375e400 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666875.140770:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140775:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140783:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:1.0:1788666875.140785:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666875.140791:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa8 expref: 19 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140802:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa8 expref: 19 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140810:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa8 expref: 19 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.140882:0:22758:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375f000/0x4267b949b564b2e1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fa8 expref: 19 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666875.140892:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707dd0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22758:1875552525099648:192.168.206.34@tcp:105: 00000100:00100000:1.0:1788666875.140950:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9370722580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666875.150711:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666875.151460:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707dd0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22758:1875552525099648:192.168.206.34@tcp:105: 00010000:00010000:1.0:1788666875.151488:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151499:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff936f4375e400/0x4267b949b564b2da lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151533:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151548:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151559:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151571:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151578:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151585:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151607:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93704dd0c800 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666875.151611:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151619:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151631:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:1.0:1788666875.151633:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666875.151637:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151643:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93704dd0c800/0x4267b949b564b389 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151653:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151660:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151666:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151672:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93705d3e0c00 already unused, calling callback (ffffffffc1a734f0) 00010000:00010000:1.0:1788666875.151675:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151681:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151710:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:1.0:1788666875.151713:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666875.151717:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666875.151723:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93705d3e0c00/0x4267b949b564b37b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666875.151978:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+19:18781:x1875552505075584:12345-192.168.206.34@tcp:57:lhsmtool_posix.0 Request processed in 22557us (22782us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788666875.151988:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 63 00000020:00080000:1.0:1788666875.151993:0:22758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788666875.152947:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505075968 00000100:00100000:2.0:1788666875.152957:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505075968 00000100:00100000:2.0:1788666875.153008:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 10 00000100:00100000:2.0:1788666875.153018:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707c73f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+19:18780:x1875552505075968:12345-192.168.206.34@tcp:49:dd.0 00000100:00100000:2.0:1788666875.153326:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707c73f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+19:18780:x1875552505075968:12345-192.168.206.34@tcp:49:dd.0 Request processed in 308us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666875.153334:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 10 00000040:00080000:3.0:1788666875.158447:0:22794:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788666875.158456:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666875.158474:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788666875.158480:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788666875.160096:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.160260:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505076096 00000100:00100000:2.0:1788666875.160269:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505076096 00000100:00100000:2.0:1788666875.160316:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 64 00000100:00100000:2.0:1788666875.160324:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+19:18780:x1875552505076096:12345-192.168.206.34@tcp:101:dd.0 00010000:00010000:2.0:1788666875.160343:0:25094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666875.160361:0:25094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b390 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7413ec121cb52fe0 expref: -99 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.160391:0:25094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9c00/0x4267b949b564b397 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.160403:0:25094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9c00/0x4267b949b564b397 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.160414:0:25094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9c00/0x4267b949b564b397 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.160531:0:25094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8a00/0x4267b949b564b390 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fe0 expref: 21 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.160556:0:25094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c9c00/0x4267b949b564b397 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.34@tcp remote: 0x7413ec121cb52fe0 expref: 20 pid: 25094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.160564:0:25094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9370439b9300) 00010000:00010000:2.0:1788666875.160567:0:25094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788666875.160570:0:25094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9370474c9c00, rc 0) 00000100:00100000:2.0:1788666875.160622:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+20:18780:x1875552505076096:12345-192.168.206.34@tcp:101:dd.0 Request processed in 298us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666875.160629:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 64 00000100:00100000:0.0:1788666875.162712:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.162784:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505076352 00000100:00100000:2.0:1788666875.162793:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505076352 00000100:00100000:2.0:1788666875.162863:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 11 00000100:00100000:2.0:1788666875.162873:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+20:18781:x1875552505076352:12345-192.168.206.34@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788666875.163109:0:22762:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788666875.163137:0:22762:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788666875.163596:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.163612:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.163623:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.163631:0:22762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.163636:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.163654:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.163678:0:22762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788666875.163781:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+22:18781:x1875552505076352:12345-192.168.206.34@tcp:35:lhsmtool_posix.0 Request processed in 908us (1085us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788666875.163789:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 11 00000020:00080000:2.0:1788666875.163794:0:22762:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666875.164294:0:22746:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666875.164302:0:22746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.164309:0:22746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8200 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:3.0:1788666875.164313:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.164321:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.164334:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff936f435c3200) 00010000:00010000:3.0:1788666875.164337:0:22746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788666875.164341:0:22746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.164347:0:22746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9370474c8200/0x4267b949b564b39e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666875.164358:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666875.164360:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666875.164362:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666875.187334:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:0.0:1788666875.187364:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:2.0:1788666875.187449:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505076480 00000100:00100000:2.0:1788666875.187461:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505076480 00000100:00100000:2.0:1788666875.187536:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505076608 00000100:00100000:2.0:1788666875.187539:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505076608 00000100:00100000:2.0:1788666875.187560:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 0 00000100:00100000:2.0:1788666875.187568:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+8:2395:x1875552505076480:12345-192.168.206.34@tcp:4:dd.0 00002000:00010000:2.0:1788666875.187613:0:24268:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9ce3fb, atime: 0x6a9ce3fa, ctime: 0x6a9ce3fb, blocks: 0x0 00010000:00010000:2.0:1788666875.187624:0:24268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.187638:0:24268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1788666875.187643:0:24268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666875.187649:0:24268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.187662:0:24268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666875.292155:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666875.292207:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707dd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525099776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788666875.292488:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666875.293984:0:25749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525099776 00000100:00100000:1.0:1788666875.293996:0:25749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525099776 00000100:00100000:1.0:1788666875.294063:0:25749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666875.294073:0:25749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525099776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788666875.294097:0:25749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 25591488 pending 4218880 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788666875.294874:0:25749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525099776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 800us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666875.294882:0:25749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788666875.295059:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666875.295150:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707dd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525099776:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1788666875.302648:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1788666875.302676:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1788666875.302981:0:24268:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788666875.302986:0:24268:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788666875.303004:0:24268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.303017:0:24268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.303027:0:24268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.303034:0:24268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8a00 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666875.303039:0:24268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.303048:0:24268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.303066:0:24268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.303074:0:24268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006889b56d/0x4267b949b564b3a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666875.303221:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+6:2395:x1875552505076480:12345-192.168.206.34@tcp:4:dd.0 Request processed in 115649us (115892us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788666875.303254:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 0 00000100:00100000:2.0:1788666875.303283:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 1 00000100:00100000:2.0:1788666875.303295:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2395:x1875552505076608:12345-192.168.206.34@tcp:4:dd.0 00002000:00010000:2.0:1788666875.303332:0:24268:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6a9ce3fb, atime: 0x6a9ce3fa, ctime: 0x6a9ce3fb, blocks: 0x2000 00010000:00010000:2.0:1788666875.303339:0:24268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.303350:0:24268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1788666875.303354:0:24268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666875.303360:0:24268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.303372:0:24268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788666875.364153:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1788666875.364458:0:24268:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788666875.364464:0:24268:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788666875.364480:0:24268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.364492:0:24268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.364501:0:24268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.364593:0:24268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9370474c8400 already unused, calling callback (ffffffffc0e627b0) 00010000:00010000:2.0:1788666875.364599:0:24268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.364606:0:24268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.364623:0:24268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666875.364630:0:24268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000362ba22b/0x4267b949b564b3ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666875.364781:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2395:x1875552505076608:12345-192.168.206.34@tcp:4:dd.0 Request processed in 61483us (177409us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788666875.364792:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 1 00010000:00010000:1.0:1788666875.549469:0:22747:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666876.178090:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178131:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178160:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178185:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178202:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178221:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178255:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178273:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178293:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.34@tcp (source: 12345-192.168.206.34@tcp) 00000100:00100000:1.0:1788666876.178322:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505077248 00000100:00100000:1.0:1788666876.178331:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505077248 00000100:00100000:3.0:1788666876.178342:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505076992 00000100:00100000:3.0:1788666876.178349:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505076992 00000100:00080000:3.0:1788666876.178375:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788666876.178394:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505077760 00000100:00100000:1.0:1788666876.178398:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505077760 00000100:00100000:3.0:1788666876.178415:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505077504 00000100:00100000:3.0:1788666876.178420:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505077504 00000100:00100000:1.0:1788666876.178425:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505077120 00000100:00100000:1.0:1788666876.178429:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505077120 00000100:00100000:3.0:1788666876.178447:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505076864 00000100:00100000:1.0:1788666876.178451:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505077632 00000100:00100000:3.0:1788666876.178452:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505076864 00000100:00100000:1.0:1788666876.178456:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505077632 00000100:00100000:3.0:1788666876.178475:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505077376 00000100:00100000:3.0:1788666876.178480:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505077376 00000100:00100000:1.0:1788666876.178484:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 15 00000100:00100000:1.0:1788666876.178495:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2395:x1875552505077248:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666876.178508:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 53 00000100:00100000:3.0:1788666876.178518:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2395:x1875552505076992:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666876.178563:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2395:x1875552505077248:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 71us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666876.178571:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 15 00000100:00100000:1.0:1788666876.178589:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 16 00000100:00100000:2.0:1788666876.178590:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552505076736 00000100:00100000:2.0:1788666876.178596:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552505076736 00000100:00100000:1.0:1788666876.178597:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2395:x1875552505077760:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:2.0:1788666876.178634:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 165 00000100:00100000:2.0:1788666876.178648:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+13:2395:x1875552505076736:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666876.182206:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2395:x1875552505076992:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 3677us (4061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.182223:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 53 00000100:00100000:3.0:1788666876.182267:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 54 00000100:00100000:3.0:1788666876.182284:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2395:x1875552505077504:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666876.182355:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2395:x1875552505077504:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 79us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.182362:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 54 00000100:00100000:3.0:1788666876.182376:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 55 00000100:00100000:3.0:1788666876.182383:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+22:2395:x1875552505076864:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666876.182412:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+22:2395:x1875552505076864:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 31us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.182419:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 55 00000100:00100000:3.0:1788666876.182431:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 56 00000100:00100000:3.0:1788666876.182439:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2395:x1875552505077376:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:3.0:1788666876.182465:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1ad00b0-8834-4215-915b-cc506c1c34f5+6:2395:x1875552505077376:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 27us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.182488:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 56 00000100:00100000:1.0:1788666876.189589:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2395:x1875552505077760:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 10981us (11373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666876.189604:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 16 00000100:00100000:1.0:1788666876.189642:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 17 00000100:00100000:1.0:1788666876.189661:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2395:x1875552505077120:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666876.189741:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e410e58-9219-4ec8-a46c-3adbd93f4c9d+5:2395:x1875552505077120:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 91us (11485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666876.189748:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 17 00000100:00100000:1.0:1788666876.189777:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.34@tcp, seq: 18 00000100:00100000:1.0:1788666876.189783:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2395:x1875552505077632:12345-192.168.206.34@tcp:400:kworker.0 00000100:00100000:1.0:1788666876.189812:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b1ad00b0-8834-4215-915b-cc506c1c34f5+5:2395:x1875552505077632:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 29us (11518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666876.189817:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 18 00000100:00080000:1.0:1788666876.190793:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666876.190804:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666876.190807:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788666876.190810:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666876.194237:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42372aab-04b6-4821-a139-fec1a872a41d+13:2395:x1875552505076736:12345-192.168.206.34@tcp:400:kworker.0 Request processed in 15581us (16144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666876.194254:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.34@tcp, seq: 165 00000100:00100000:3.0:1788666876.316547:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525100288:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.316610:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666876.316639:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525100800:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.316659:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666876.316673:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875552525101312:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.316717:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666876.316741:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788666876.316747:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff937074ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525100160:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.316767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666876.316780:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525100672:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.316796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666876.316810:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875552525101184:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.316825:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666876.316882:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525100288 00000100:00100000:3.0:1788666876.316889:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525100288 00000100:00100000:3.0:1788666876.316924:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525100800 00000100:00100000:3.0:1788666876.316927:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525100800 00000100:00100000:3.0:1788666876.316938:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525100160 00000100:00100000:3.0:1788666876.316940:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525100160 00000100:00100000:3.0:1788666876.316958:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525100672 00000100:00100000:3.0:1788666876.316960:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525100672 00000100:00100000:3.0:1788666876.316975:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788666876.316982:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525100288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317027:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525100288:12345-0@lo:400:kworker.0 Request processed in 44us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.317049:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788666876.317064:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788666876.317070:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f42525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525100800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317095:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f42525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525100800:12345-0@lo:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.317101:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788666876.317110:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788666876.317115:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525100160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317138:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875552525100160:12345-0@lo:400:kworker.0 Request processed in 23us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.317143:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788666876.317152:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788666876.317157:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525100672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317179:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875552525100672:12345-0@lo:400:kworker.0 Request processed in 23us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.317185:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788666876.317207:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525101312 00000100:00100000:3.0:1788666876.317211:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525101312 00000100:00100000:3.0:1788666876.317235:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525101184 00000100:00100000:3.0:1788666876.317237:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525101184 00000100:00100000:3.0:1788666876.317256:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666876.317261:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875552525101312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317290:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875552525101312:12345-0@lo:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.317297:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666876.317315:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788666876.317320:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f436e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875552525101184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317347:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f436e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875552525101184:12345-0@lo:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.317353:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788666876.317370:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788666876.317374:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666876.317377:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666876.317414:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff937074ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525100160:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317425:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525100672:0@lo:400:kworker.0 00010000:00080000:3.0:1788666876.317436:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f42527480 x1875552525101184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666876.317446:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875552525101184:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317455:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1788666876.317460:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93707dd58700, transno 12884901892 00000004:00080000:3.0:1788666876.317471:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1788666876.317490:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875552525100288:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317499:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875552525100800:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.317508:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875552525101312:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.317707:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525099904:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.317750:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666876.317792:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525100416:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.317814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666876.317828:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525100928:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.317873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666876.317888:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875552525101440:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.317908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666876.317923:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788666876.317930:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525100032:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.317954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666876.317974:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f427f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525100544:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.317994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666876.318007:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f42527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875552525101056:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.318025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666876.318047:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525100032 00000100:00100000:2.0:1788666876.318051:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525100032 00000100:00100000:2.0:1788666876.318077:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525100544 00000100:00100000:2.0:1788666876.318080:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525100544 00000100:00100000:2.0:1788666876.318093:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788666876.318099:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525100032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.318134:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525100032:12345-0@lo:400:kworker.0 Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666876.318141:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788666876.318154:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788666876.318159:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525100544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.318194:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875552525100544:12345-0@lo:400:kworker.0 Request processed in 35us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666876.318199:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788666876.318228:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525100032:0@lo:400:kworker.0 00000100:00100000:2.0:1788666876.318237:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875552525100544:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.321975:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525099904 00000100:00100000:3.0:1788666876.321990:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525099904 00000100:00100000:3.0:1788666876.322065:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788666876.322074:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f434cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:3640:x1875552525099904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.322162:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f434cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a62c9863-c7b0-471d-812b-42670ca06572+24:3640:x1875552525099904:12345-0@lo:400:kworker.0 Request processed in 89us (4411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.322182:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788666876.322219:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525100416 00000100:00100000:3.0:1788666876.322224:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525100416 00000100:00100000:3.0:1788666876.322245:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525100928 00000100:00100000:3.0:1788666876.322248:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525100928 00000100:00100000:3.0:1788666876.322260:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525101440 00000100:00100000:3.0:1788666876.322262:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525101440 00000100:00100000:3.0:1788666876.322286:0:25094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525101056 00000100:00100000:3.0:1788666876.322289:0:25094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525101056 00000100:00100000:3.0:1788666876.322305:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788666876.322311:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525100416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.322355:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875552525100416:12345-0@lo:400:kworker.0 Request processed in 44us (4540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.322361:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788666876.322374:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788666876.322380:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525100928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.322408:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875552525100928:12345-0@lo:400:kworker.0 Request processed in 28us (4534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.322413:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788666876.322425:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788666876.322430:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875552525101440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.322456:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875552525101440:12345-0@lo:400:kworker.0 Request processed in 26us (4547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.322460:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788666876.322470:0:25094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788666876.322475:0:25094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875552525101056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.322510:0:25094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875552525101056:12345-0@lo:400:kworker.0 Request processed in 35us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.322516:0:25094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788666876.322534:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666876.322538:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788666876.322581:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875552525101056:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.322593:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a62c9863-c7b0-471d-812b-42670ca06572:3640:1875552525099904:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.322604:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875552525100416:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.322614:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f427f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875552525100928:0@lo:400:kworker.0 00010000:00080000:3.0:1788666876.322640:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff936f42524700 x1875552525101440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666876.322651:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f42524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875552525101440:0@lo:400:kworker.0 00000100:00100000:3.0:1788666876.326239:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666876.326268:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525101568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666876.326343:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666876.326400:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525101568 00000100:00100000:3.0:1788666876.326407:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525101568 00000100:00100000:3.0:1788666876.326460:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666876.326469:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f43761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525101568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666876.326495:0:24266:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3676631040 00000100:00100000:3.0:1788666876.326540:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f43761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875552525101568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666876.326546:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666876.326590:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875552525101568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666876.327300:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff936f43795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525101696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666876.327342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666876.327405:0:25749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525101696 00000100:00100000:2.0:1788666876.327411:0:25749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525101696 00000100:00100000:2.0:1788666876.327448:0:25749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788666876.327457:0:25749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93707dd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525101696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666876.327480:0:25749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788666876.335817:0:25749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93707dd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875552525101696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8352us (8464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666876.336004:0:25749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788666876.342615:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff936f43795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875552525101696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666876.571951:0:24288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788666876.794575:0:25841:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:3.0:1788666877.212118:0:22794:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788666877.212200:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666877.212228:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788666877.212239:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788666877.598095:0:22746:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666877.852111:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666877.861445:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93707dd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525101824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788666877.861548:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666877.864444:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552525101824 00000100:00100000:1.0:1788666877.864459:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552525101824 00000100:00100000:1.0:1788666877.864582:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788666877.864594:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936f4441dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525101824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788666877.864630:0:24265:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788666877.864745:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936f4441dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875552525101824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666877.864752:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788666877.864887:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93707dd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875552525101824:0@lo:13:osp-pre-0-1.0 Debug log: 14038 lines, 14038 kept, 0 dropped, 0 bad.